DSAN Students in Our Climate Change Course Evaluate New ClimateGPT, Built by Erasmus.AI
ClimateGPT, built by Erasmus.AI is an AI-powered platform designed to assist users in understanding climate change and its impacts. In a data science class at Georgetown University, under the guidance of Prof Dan Loehr students had the opportunity to evaluate ClimateGPT‘s performance against real task-driven questions.
Read the post in full on Erasmus.AI’s blog:
The challenge of evaluating AI models, is beyond simple classification benchmarks to open ended questions which test the robustness of models through real world interaction.
-Daniel Erasmus, CEO
Working together with team at Georgetown University we could see that models with High Quality Climate RAG significantly outperformed our original benchmarks.