“A recent Gartner poll shows that while 55% of organizations are experimenting with generative AI, only 10% have put generative AI into production. One of the biggest barriers to productionizing LLMs is dealing with their tendency to produce bogus outputs known as hallucinations, which precludes their use in applications where correct outputs are necessary (i.e., most applications)! Despite this, some organizations have deployed these unreliable LLMs, sometimes with catastrophic results. Air Canada’s chatbot hallucinated refund policies, eventually resulting in the airline being held responsible for the misinformation and being ordered by a tribunal to refund a customer; the chatbot has since been taken down. A federal judge fined a law firm after their lawyers used ChatGPT to draft a brief full of fabricated citations. New York City’s “MyCity” chatbot has been hallucinating wrong answers to business owners’ questions about local laws.”

https://cleanlab.ai/blog/trustworthy-language-model/

Do we have any hopes of overcoming this? One startup claims they have a good answer.

"LLMs will always have some hallucinations, but by providing a trustworthiness score with every output, Cleanlab TLM lets you identify when the LLM is hallucinating."

 https://cleanlab.ai/blog/trustworthy-language-model/

The Center for Women in Technology periodically receives donations from individuals and organizations who want to support students through scholarships. We are currently accepting applications for these Donor-Supported Scholarships for the 2024-25 academic year. Current COEIT undergraduate students of all genders in good academic standing are welcome to apply. The awards will be made by the beginning of the Fall 2024 semester, and range in amount from $1000 to $3000 for the academic year. Eligible students will be able to view the opportunity in Scholarship Retriever: https://umbc.academicworks.com/ 

The deadline to apply is June 7, 2024. Questions? Contact Dr. Seaman at cseaman@umbc.edu.  

APPLY HERE 

As a GAO intern, you will learn how to conduct federal audits and program evaluations and apply that knowledge as part of a team. You will assist GAO analysts in planning and conducting in-depth reviews of executive and legislative branch programs. You will collect appropriate data, analyze the data, develop data-based findings and conclusions, and present the information both orally and in writing to diverse audiences.

Specific duties include:

• Planning, prioritizing, and/or balancing own work assignments, identifying feasible work management approaches that address required activities and timelines.
• Developing, identifying, contributing to, and/or using techniques, tools, and processes that are methodologically sound and targeted to job requirements.
• Collecting relevant information that is aligned with objectives/planning decisions and meets needs.
• Conducting analyses that yield quality information aligned with needs; identifying relevant information, patterns/inconsistencies, relationships, interdependencies, and potential implication.
• Preparing quality written work that meets relevant writing and evidence standards, and that is appropriately targeted to the audience and purpose.
• Communicating relevant and accurate information during formal or informal presentations, meetings, or interviews.
• Partnering or collaborating with others to address issues or solve problems; following up with others to ensure needs are met.
• Contributing to team efforts through participation in activities/meetings, soliciting and listening to others' opinions, and working collaboratively to accomplish team goals.
• Soliciting, listening to, and considering diverse perspectives, approaches, or viewpoints, and incorporating others' perspectives into decision-making (when appropriate).