RESOURCE: UC AI Workshop – Summary report

The Future of AI

Over 250 senior administrative leaders across the University of California recently met to explore the transformative potential of AI across enterprise, academic, research and health administration. The gathering, focusing on interactive workshops, allowed leaders to develop a common framework, and grow their understanding of important considerations, centering on the AI principals – guidelines to ensure safe, respectful and effective implementation of AI. Participants also spent timechanging news about specific projects. They ruminated about their top priorities and business challenges, learned about new tools, and fostered a new network of colleagues and established areas of possible collaboration as they take their work to the next level. Their key takeaways were about using a pivotable opporutunity in the tech industry to exercise rigor in using strong management techniques and capitalizing on their UC-wide network, while remaining vigilant in their efforts to take their understanding of emerging technologies to the next level. A summary of takeaways is provided below.

Workshop takeaways

  1. The ability to share ideas, systemwide, is a unique value of the UC tech community. We need to take time to capitalize on this, as we have done in this two-day workshop.
  2. It may be difficult to do everything at once – to be first to market, while being 100% accessible to all stakeholders and have taken time to consider all future ramifications of execution, from privacy and security to long-term cost and societal implications.
  3. Clarifying AI project value propositions and looking at contextual factures inside and outside the organization will ensure long-term success, though this process may need to be expedited to achieve deadlines and stay ahead of the competition. Gartner, who provided several elements of the workshop, dubbed this “Setting your AI ambition.”
  4. The university, innovators in the creation of AI and implementation for the purpose of research, patient care student education, has the opportunity to apply this technology and mindset of discovery and excellence to improve administration and operations. 
  5. The question of time and money loomed large, with diverse views about which stakeholders had the greatest opportunities to work with these valuable tools. Is it faculty and researchers and staff second? People shared differing views, but a unified vision that administrative excellence is paramount to the overall success of the university, and to each mission area.
  6. Using human skills of integrity and creativity, and obviously domain expertise, to not only set up AI processes, but to review the conclusions drawn by the data and algorithms we feed it, is critical. At the workshop, Gartner dubbed this as “Human in the loop.”
  7. With any emergent technology or trend, the expansion of AI is disruptive. Organizations can be displaced by others unless they find efficient ways to meet the evolving needs and expectations of their customers. Balancing transformation with the complexities of a large and diverse organization may not be easy, but this will be important to the future success of the UC.
  8. Consistency in defining priorities and a common understanding of the university’s mission, vision and values, in the context of AI, will be key to success. All teams must exhibit a sophisticated level of skill in both business management and technical acumen, and understand clearly the complex relationship between the factors mentioned above: time-to-market vs compliance and cost savings; open access to tools and technologies vs justification; remaining true to the mission of serving patients, students, researchers and the general public, while remaining competitive through budget controls and rapid change.

Other thoughts to consider included:

  • Job security and upskilling the workforce
  • Cost, risk and complexity of data quality at an institution that has some of the largest data sets in the world
  • Servicing/funding the immediate demand for AI equitably across functions and other stakeholder types

Workshop elements

The workshop programming committee* created a unique agenda* to maximize learning from thought-leaders and among peers, including the following elements:

  • Leaders inside and outside UC provided important context: In-depth workshops on AI roadmaps, governance, and strategic deployment, tailored to address sector-specific challenges.
  • Interactive on-stage discussions, breakouts supported colleague-to-colleague learning: A showcase of AI-driven projects across the UC system, where attendees could exchange ideas and explore solutions.
  • A graphic designer documented the workshop real-time: The graphic recorder provided high-quality images, and thought-provoking sessions on AI-driven innovation, including expert insights from leading voices, in higher education and AI.

The sections, below, are based on the workshop agenda.

Key Insights and Themes

Part 1: Setting the stage for the interactive workshop:

Opening Remarks

Conference leads Van Williams, Alexander Bustamante, and Camille Crittenden welcomed the participants, highlighting that AI engagement does not require technical expertise but must be balanced with privacy and compliance. Camille Crittendon encouraged participants to identify three challenges AI might solve, learn about three new tools, and connect with three new colleagues.


Interactive Plenary: “We Shape AI, AI Shapes Us”

Don Scheibenreif, Gartner

During the first presentation, “Interactive Plenary: We Shape AI, AI Shapes Us,” Don Scheibenreif presented an overview of AI’s lifecycle, noting a decline in the “hype cycle” due to operational and societal challenges. His colleague joined him to answer questions. They discussed philosophical considerations, such as human vs. machine intelligence, and emphasized that job security will not be in danger.  They introduced several terms which may be adopted across the university, including “Everyday AI – typically for administrative purposes and “Game changing AI,” typically for customer-facing applications in research, student education, and research.

The infographic provides a visual snapshot of the Interactive Plenary: We Shape AI, AI Shapes Us.

We Shape AI and AI Shapes Us
Altext/Caption: Interactive Plenary: We Shape AI, AI Shapes Us by Don Scheibenreif, Gartner
Gartner is here to help you with your AI journey; Hype cycle for AI; Fundamental shift in the relationship between human and machine; AI cannot do predictions and forecasting – you need creativity for that. There is a fundamental shift in the relationship between human and machine – from tool to teammate; Game-changing vs everyday AI; You need to consider not only “can we do this,” but “should we do this.” You will need to create an “AI vision,” as well as your “AI Ambition; “The term “Lighthouse principles” references your ethics; The more specific you are, the better your governance is going to be; If your data is not ready, you are not ready for AI; AI will create more jobs than it eliminates. How to not have AI exacerbate negative aspects of society – sexism racism; Human in the loop; Everyday AI will not provide a competitive advantage, but game changing AI will.

A panel of technology leaders providing UC-wide insights: “UC AI Innovation Spotlight”

This panel including several CIO’s and one chief data officer. Alex Bui, UCLA, moderator, with panelists Tom Andriola, UC Irvine, Vince Kellen, UC San Diego, Lucy Avetisyan, UCLA and Ki Lai, UCSF

The  “UC AI Innovation Spotlight” featured a panel including several CIO’s and one chief data officer.
Alex Bui, UCLA, moderator, with panelists Tom Andriola, UC Irvine, Vince Kellen, UC San Diego,
Lucy Avetisyan, UCLA and Ki Lai, UCSF

Moderated by Alex Bui, five UC technology leaders, including representatives from UCLA, UC San Diego, UCSF, and UC Irvine,  shared campus-specific AI advances. Vince Kellen, UC San Diego, and Tom Andriola, UC Irvine,  described their custom-built AI models using campus data and secure infrastructure, and Ki Lai, UCSF, discussed the LLM  solution being rolled out at UCSF called Versa. Lucy Avetisyan, UCLA noted that her campus is the first UC to contract with ChatGPT. She emphasized the need for rigorous vetting in tool adoption to manage legal and privacy risks. Ki Lai added that prioritizing protocol not only ensures security but promotes inclusion by modeling caution.

UC Innovation Spotlight
Altext/Caption: CIO Panel UC AI innovation spotlight with Alex Bui, Tom Andriola, Vince Kellen, Lucy Avetisyan, Ki Lai. Insights into successful implementation of AI; It’s an all-of-us topic (Tom); Bad data is bad AI. Garbage in….garbage out. Bad chatbots deployed in the past; Human in the loops; AI governance; I have the hammer, where are the nails; AI for administration is not as easy as processing grapefruit; AI governance is a continuous process; Human involvement is always going to be essential; Probabilistic vs deterministic systems; Democratize the data; AI is expansive, is it inclusive – we have the repository to offer it to our community at large; Think about the students; We have to be challenging everything; Build your AI literacy- start with your people; UCSF invested heavily in training; UCSF – create an effective governance, safely integrate; “We are in the early stage of adoption”


After-dinner interactive session and preparation for the morning workshop: The Future of AI

Don Scheibenreif, Gartner, led participants in a discussion regarding administrative challenges AI could address, such as email overload, performance reviews, writing job descriptions and other labor-intensive tasks. They led an activity using a quadrant “radar” model to map AI adoption across administrative and front-facing operations, prompting participants to design a custom radar for their own teams, during in their breakout sessions  the next day.

The Future of AI

Altext/Caption: The Future of AI, Don Scheibenreif, Gartner: Efficiency and compliance; The future of AI  is all of you. What would people in the room like: A system to compare policies for contracting; An AI that can look at your initial projects and identify risks; Contribute to student success; To support AI compliance; Automating catalog of back log material that would include image recognition; Job descriptions; Read my emails for me; Performance evaluations; Assess cost of construction; Easier financial aid for students and governments; Getting ready for audits


Fireside Chat with AI Leaders: AI in Higher Education Administration


Rachael Nava, UC Office of the President, moderator, with panelists Sasha Sidorkin, California State University, Sacramento, Marc Sedam, New York University

VP of Administration and Chief Operating Officer, Rachael Nava facilitated a discussion with technology leaders at New York University (NYU) and California State (CSU) university. The discussion highlighted the diverse ways institutions approach AI to optimize operations, including NYU’s $50M savings through AI-based patent tracking, and numerous thought-provoking considerations, which were new/intriguing to the audience such as the belief that privacy and security concerned were over-exaggerated, or that any institution should attempt the creation of their own GPT, given the massive capabilities of OpenAi.

Fireside Chat with AI Leaders
Altext/Caption: Fireside Chat – AI in higher education – Rachael Nava, Sasha Sikorkin, Marc Sedam. Beware of tech companies that want to offer you free GPU (our data is extremely valuable); How do we leverage our precious resources to optimize operations; How AI is being used – Contract comparison;  The impact of chatbots on education; Taking away the annoying things no one wants to do, and leaving more room for creativity; Administrative efficiency; Priorities – just because AI can do something, does not mean that your organization wants to do it; New technologies are going to create new exciting jobs. Invest in retention. With new technologies come new opportunities; Environmental impact; We believe AI is definitely worth it…..AI can allow you to  save all the money you have to initially invest; Cost benefit analysis; Start with the measurements – have the metrics down. If you can’t see the results, AI is not going to be any help. We cannot overregulate right now. Europe has fallen behind because of regulation. Security – the is  general sense of panic. The security issues are currently greatly exaggerated. Security it’s not a new problem.

Day 2 Highlights

Workshops and Collaboration

Jenny Loftus, conference co-chair with Van Williams and Camille Crittenden, welcomed participants to day 2, and facilitated the day’s workshops and a share fair with interactive stations. Over the course of two breakout sessions (one in the morning and one in the afternoon), participants were grouped by the principal aspect of the university  mission they serve (i.e. research, education, patient care, or business processes) and phase of maturity, from considering AI tools to rolling them out at scale. Cohorts identified and prioritized challenges AI could solve while accounting for legal, privacy, and cost considerations. They had the opportunity to work with the AI principals in-depth, while learning more about their colleagues and their work in addressing AI across the state.


Business Perspective on AI by a UC Berkeley Haas professor of engineering and business administration

Keynote: Deploying A.I. – Unlocking the Strategic Potential, Avoiding Pitfalls, and Getting the Organization Ready
Saikat Chaudhuri, Berkeley Haas

UC Berkeley professor Saitkat Chaudhuri presented on the business implications of AI, emphasizing a problem-first rather than tool-first approach. He warned against viewing AI as a standalone “strategy,” instead promoting its integration to solve specific challenges. At the same time, he advocated for strategic discussions that go beyond the administrative functions of the university and look at the business landscape as a whole. He introduced the importance of clearly articulating the value proposition and measuring progress against goals, on the one hand, while considering rapid innovation on the other.”

Deploying AI
Altext/Caption: Keynote: Deploying A.I. – Unlocking the Strategic Potential, Avoiding Pitfalls, and Getting the Organization Ready, Saikat Chaudhuri, Berkeley Haas, Deploying AI – no better system than the UC’s – he doesn’t ask for permission, but asks later for forgiveness, as needed. We learn from one another. Where are we today? We are considering AI, but undecided vs deploying AI; Unlocking the strategic potential, avoiding pitfalls, and getting the organization ready; Experimentation; Pitfalls/challenges – Data quality, ethical considerations, security, safety, privacy; Value proposition – AI cannot be a human…yet, spectrum of weak to strong AI; Framework; Transitioning your organization through Leadership vision and strategy  to understand why to priority, and achieve alignment; have a clear value proposition. BEFORE you start thinking of use cases, get yourself ready (i.e. look at the business context) The visual 2×2 framework shows that the axis for building and implementing solutions is partnering; Determine your actions based on evidence; Pitfalls- false claims: (1) thinking robots will replace our jobs; (2) assuming everyone will understand the benefits; (3) not understanding its transformative potential; (4)  Striving for the shiniest algorithms; (5)  implementing without a good value proposition; (6) Not considering the risks of irresponsible AI; (6) Big data does not mean AI ready; Process transformation requires an evidence based mindset and continuous improvement.


Final Panel – The value of UC-wide collaboration across team working in different arenas

Panel: Power of 10 – Strategic Partnerships, Policy, and Direction
Alex Bustamante, UC Office of the President, moderator, with panelists Cora Han, UC Health, Dennis Chornenky, UC Davis Health, Günter Waibel, California Digital Library, Simon Atkinson, UC Davis, and Chuck Haines, UC Santa Barbara

The panel title, “Power of 10,” alludes to the 10 academic campuses across the state (UC Berkley, UC Davis, UC Irvine, UCLA, UC Merced, UC Riverside, UC San Diego, UC San Francisco, UC Santa Barbara, and UC Santa Cruz.) A panel of leaders in research, patient care, and library services discussed their roles within the UC mission. Echoing earlier insights, they noted AI’s broader adoption in research (“front office” in research terms) compared to administrative functions (“back office”) and advocated for ongoing cross-UC collaboration.

Power of 10
Altext/Caption: Power of 10 – strategic partnerships, policy and direction. Simon Atkinson, Chuck Haines, Alex Hui, Cora Han, Dennis Chornesnky, Gunter Waibel. Need to scale up ADA compliance – we have to look at computational solutions. Leveraging the vast amount of our data. We have the largest academic research library in the country. AI agents will replace our junior-level jobs. Challenges: unwillingness to invest, it is a steep learning curve, the talent and skill gap. The need to look across our campuses. We need to learn from our peers. Reach out and share. Communications will be key to success.

Conclusions and next steps

The conference underscored the UC system’s commitment to responsibly expanding AI use across all functions. Leaders are now equipped to prioritize problem-solving with AI, keeping inclusion, privacy, and compliance at the forefront.

Van Williams closed the workshop, commending the rich discussion, the contributions by participants, speakers and the planning committee and conference organizations, including Kristin Cordova, chief of staff to Van Williams. He highlighted  the AI Council as a valuable resource for continued collaboration, encouraging attendees to utilize the Council’s resources and expertise.

Balancing, considering:

  1. Starting with ideas and use-cases vs starting with business problems and budgets
  2. Encouraging consolidated approaches vs encouraging diversity of execution and innovation
  3. The importance of accurate, well-organized data, and alignment before implementation

Share Fair Presenters

UCI Enrollment management; Exploring the feasibility of integrating VR for a hybrid work modality; Challenges  – not necessary or cost effective for all job functions; Physical barriers; current, platform, docs); UCSF Versa; Multiple data sources; Computer vision co-pilot 9 improving people’s lives – through the use of AI; Risk and safety solutions – we are making magic – 8 hours of safety data sheets in minutes AI-driven solutions for risk reduction(posture detection); AI training data – opportunity; Leverage UC content to create a public good training corpus; Retain copyright for UC authors, while providing accessibility to broad audiences; CDL seeking collaborations to build scalable projects; Digitizing public domain books

Accelerating Onboarding and Change Support through ThoughtExchange

Kevin Reyes

Come see how we accelerated onboarding for our new Vice Chancellor of Enrollment by gathering division-wide input in just one week, producing insights equivalent to 3-6 months of discussions. Additionally, using ThoughtExchange, we quickly identified top training needs for the rollout of the Core Competency ABCs, allowing us to address key challenges and implement solutions ahead of the performance management cycle. Complete the two exchanges for the AI in Transformations Event to see how this works in real time: 1) Expectations and Insights on Challenges and Opportunities for AI in our University Setting 2) Input from Participants on What You Are Most Excited About Connecting About.

Advancing Accessibility and ADA Compliance with Artificial Intelligence and Collaboration

Danielle Watters Westbrook, Erik Mitchell, Günter Waibel

The California Digital Library (CDL) is investigating potential opportunities to utilize artificial intelligence and machine learning (AI/ML) to enhance the accessibility of web-based content and ensure compliance with the recent revisions to Title II of the Americans with Disabilities Act (ADA). CDL seeks UC-wide partners to join us in better understanding our shared challenges and to explore if AI/ML – whether UC co-developed applications or services via third parties – might offer scalable solutions for accessibility, including assessing and remediating content.

AI-Driven Solutions for Ergonomic Risk Reduction

Stefan Tomic

The RSS (Risk Safety Solutions) AI initiative utilizes advanced vision recognition, pose detection, and wearables technology to proactively reduce ergonomic-related injuries and enhance workplace safety. By rapidly identifying unsafe postures and movements, the initiative provides immediate feedback and expert insights, transforming safety oversight and significantly improving health and cost-efficiency across the organization.

Gecko Chatbot

Sherwynn Umali

In response to the increasing demands on administrative staff, UCI’s Division of Student Affairs launched the Gecko chatbot to enhance operational efficiency and streamline communication. Initially piloted on five departmental websites, the chatbot successfully automated routine inquiries, reduced email and phone call volumes, and improved user experience, leading to plans for expanded functionality and broader adoption across the institution.

Hey Bruin: AI Personal Assistant Prototype

Anna Ahearn, Jesus Ramirez

UCLA partnered with Google to develop a groundbreaking GenAI prototype powered by Google AI tools. This innovative solution aims to improve the student experience by instantly connecting students with accurate financial aid information and resources by curating and personalizing answers to student questions.

Innovating Enrollment Management: Leveraging Emerging Technologies for Success

Darren Endo, Huma Madinawala, Jun Xiang, Tony Hwang (via VR)

In response to the challenges posed by the COVID-19 pandemic, the Office of Enrollment Management at UC Irvine embraced innovation by exploring emerging technologies to enhance productivity, collaboration, and employee well-being. By integrating virtual reality for remote work, implementing a chatbot for customer service, and piloting extended reality in student recruitment, UCI has transformed enrollment management, achieving improved efficiency and student engagement while setting a new standard for institutional practices.

Machine Learning for Enhanced Workplace Safety

Diana Cox

RSS’s machine learning initiatives have revolutionized operational efficiency across UC campuses by transforming injury data into actionable insights, enabling precise forecasting for injury mitigation and informed decision-making. By automating the analysis of Safety Data Sheets and enhancing data visibility, these AI-driven solutions significantly reduce the time and resources required for data management, ultimately improving safety and productivity in laboratories and workplaces.

PolicyWonk

Adam Getchell

PolicyWonk simplifies navigating UC Davis policies for everyone—whether you’re a student, faculty member, staff, or administrator. With this tool, accessing and understanding university policies is faster and more convenient than ever.

The University & AI Training Data: Authors, Libraries and the Public Good

Danielle Watters Westbrook, Erik Mitchell, Günter Waibel

AI requires high quality training data. The university generates (scholars) and stewards (libraries) vast amounts of peer-reviewed scholarly content. Positioning this content as a public good creates an open AI training corpus that turns the university from a mere consumer into an active participant, and disrupts a marketplace in which we repeatedly pay for our own content in the guise of different products.

TritonGPT

Shawn Munro

TritonGPT is a generative AI platform developed at UC San Diego to democratize access to AI by providing affordable, context-specific solutions through retrieval-augmented generation. Leveraging existing expertise and infrastructure at the San Diego Supercomputer Center, TritonGPT ensures the protection of sensitive data while making advanced AI capabilities accessible to a broader range of organizations and individuals.

UC Tech News

Laurel Skurko

UC Tech News connects those working closely with university technologies. Top topics include AI, privacy, cyber security, digital accessibility and user experience, and how these relate to organizational opportunities.  It is created by the UC Tech community, with 11,000 tech employees across 30+ UC entities, and is published weekly by the UC Office of the President.

Versa

Joseph Owens, Victor Galvez

In response to the risks posed by AI, UCSF developed Versa, a secure AI platform that transforms clinical care, research, education, and administration while safeguarding sensitive information. Created by a multidisciplinary team, Versa improves workflow automation, enhances data interaction, and supports over 4,300 users, driving innovation and operational efficiency across UCSF.

ZotGPT

Max Garrick, Sarkis Daglian

ZotGPT is UC Irvine’s campus-wide AI solution designed to enhance teaching, administration, and research by providing secure, cost-effective access to generative AI. Leveraging a collaborative effort and built on Azure OpenAI and AWS infrastructure, ZotGPT improves efficiency through tools like ClassChat, a virtual tutor, and API integrations that empower researchers and administrators.

Share Fair
Altext/Caption: Share Fair – use case successes. UCI Enrollment management; Exploring the feasibility of integrating VR for a hybrid work modality; Challenges  – not necessary or cost effective for all job functions; Physical barriers; current, platform, docs); UCSF Versa; Multiple data sources; Computer vision co-pilot 9 improving people’s lives – through the use of AI; Risk and safety solutions – we are making magic – 8 hours of safety data sheets in minutes AI-driven solutions for risk reduction(posture detection); AI training data – opportunity; Leverage UC content to create a public good training corpus; Retain copyright for UC authors, while providing accessibility to broad audiences; CDL seeking collaborations to build scalable projects; Digitizing public domain books

Event Program Committee

Ki Lai

Jenny Lofthus

Camille Crittenden

Alex Bui

Alex Bustamante

Tom Andriola

Dennis Chornenky

Marc Fisher

Chuck Haines

Erich van Rijn

Guenter Waibel

Darnele Wright

Lucy Avetisyan

Brett Pollack

Paul Williams

Gillian Wilson

Mike Kennedy

Van Williams

Kristin Cordova

Cora Han

Eugene Whitlock

Related reading

September 30, 2024, NEWS: Summary Report – UC AI Congress, UC Tech News

September 1, 2024, EVENT: UC AI Workshop, September 30 – October 1, 2024 – LEARN MORE, UC Tech News

Contact

Kristin Cordova
Event Local Arrangements Chair
Kristin Cordova
Chief of Staff
UC Office of the President
Kristin.Cordova@UCOP.edu

Event programming committee

AI Council Sponsors