Introducing a Multi-Provider AI Gateway to Enterprise AI SaaS for Orchestration, Observability and Scalability

I was hired as an AI specialist and backend developer to contribute to the development of the client's own enterprise SaaS platform called BusinessGPT, which is an AI platform for businesses with an active and growing customer base. My contribution was - among other things - to make BusinessGPT more scalable and provider / cloud agnostic and to fascilite agentic workflows and observability by introducing an AI gateway, serving as an orchestration proxy layer inbetween users of their platform and the underlying LLMs.