Brainberg
How to evaluate your first AI agent ? PyData Sofia Meetup 24 Nov 2026
AI Integration & ApplicationMeetupFree

How to evaluate your first AI agent ? PyData Sofia Meetup 24 Nov 2026

Tue 24 Nov · 17:00
Sofia, 🇧🇬 Bulgaria
< 50 attendees
SiteGround HQ · ж.к. София парк Младост, ул. „Олимпийска“ 6

About this event

We created our own AI agent, but the question remains - how do we know that it performs good ? If you want to understand how to put LLM performance into numbers you can understand, join us on Nov 24, 2026 for a walkthrough on evaluating AI agents. (Important: The event requires a mandatory registration)

AI agents can execute tools, search the web, understand images and read skills, depending on the output from the LLM underneath. But how can we be sure that our agent is calling the right tools ? If we change the model, can we expect the same performance, or better ?

AI evaluation techniques allow us to give a quantifiable metric on all those things. We can observe what tools are being called by the model and then evaluate how many times the correct tool was executed.

In this meetup, we will use LangFuse to create a set of evaluations that can help us measure the performance of our agent. We will dive into performance metrics, as well as cost. All of these metrics can help us make better decisions about our agent - do we need a bigger model, or can we decrease the cost of running it.

After we see the numbers from our agent, we can have a quick chat and enjoy some drinks and food (provided by SiteGround)

If this sounds interesting to you, make sure to sign up below:

Speaker bio:
Zdravko is an AI Evaluation Engineer at SiteGround, building the frameworks and tests that determine how well AI systems actually perform. He's been at the company for ten years, moving through technical support and team leadership before landing in his current role. He holds a Business Ethics degree and brings that lens to the harder questions in the space — whether AI systems behave consistently, and whether they're genuinely helpful to the people relying on them.

Agenda:
19:00 - 19:10: Opening & introduction
19:10 - 20:10: How to evaluate your first AI agent
20:10 - 20:15: Closing & SiteGround Raffle with gifts
20:15 - 21:00: Networking with drinks and food (provided by SiteGround)
Place: SiteGround HQ , 6 Olimpiyska st., Sofia
Parking: available
Directions: https://www.google.com/maps/place/g.k.+Sofia+parkMladost,+ul.+%22Olimpijska%22+6,+1766+Sofia/@42.6228344,23.3692001,3a,90y,270h,84.41t/data=!3m7!1e1!3m5!1sxcFgY8KOgVqqw7dZJ-Y70w!2e0!6shttps:%2F%2Fstreetviewpixels-pa.googleapis.com%2Fv1%2Fthumbnail%3Fcb_client%3Dmaps_sv.tactile%26w%3D900%26h%3D600%26pitch%3D5.590685654068935%26panoid%3DxcFgY8KOgVqqw7dZJ-Y70w%26yaw%3D270!7i16384!8i8192!4m6!3m5!1s0x40aa813466d6ce39:0xb464d77033cdd740!8m2!3d42.6229584!4d23.3679717!16s%2Fg%2F11sjsgh0c6?entry=ttu&g_ep=EgoyMDI2MDMyNC4wIKXMDSoASAFQAw%3D%3D

Source: meetup