Staff AI Engineer

This is a hybrid role in the San Francisco Bay Area that will require 2x days onsite per week.


About Galileo

Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the world's most ubiquitous AI applications including Apple's Siri and Google Speech. We firmly believe that AI developers require meticulously crafted, research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.


Galileo addresses the complexities inherent in implementing, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers' ability to refine and deploy reliable and precise GenAI applications.


Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others. 

Galileo has AI research at its core, with the founders coming from Google and Uber where they solved challenging AI/ML problems in the Speech, Evaluation and ML Infra domains. It is now a Series B business backed by tier 1 investors including Battery Ventures, Scale Venture Partners, and Databricks Ventures, with $68M in total funding. We are headquartered in San Francisco with locations such as New York and Bangalore, India forming our areas of future growth.


Main Responsibilities

This role will be as an AI Engineer in a product-driven Generative AI solutions team. This team  builds Generative AI and Applied AI solutions for enterprises, bridging the last-mile gap between the latest research developments and commercial deployments. The work involves  end-to-end systems design to develop vertically-integrated, scalable, industry-specific and differentiated applications that are then deployed as a SaaS product or in our customer’s cloud environment (AWS, GCP, Azure, …)


The ideal candidate has the following abilities.

  • Can work in a fast paced environment and can get ideas quickly off the ground with minimal support (ideally has experience working in a mix of large enterprises and startup experience) 
  • Work with top applied AI researchers in pushing the envelope of trustworthy GenAI development
  • Be a strong source of ideas, communicated often to push the boundaries of the product to enhance how developers create and innovate with AI.
  • Collaborate with engineering and product management to deeply understand the use cases of AI developers and build innovative features
  • Read and research the latest advancements in LLM literature and integrate relevant insights into Galileo's product offerings
  • Work with Platform Engineers and Frontend teams, to ensure efficient computation times and delivery of robust AI algorithms (is comfortable in a cloud based CI/CD setup)

Minimum Qualifications

  • 7+ years of experience in Applied AI, implementing ML algorithms to launch products at scale.
  • Deep familiarity with large language models (aka LLMs) in theory and practice
  • Working experience with Pytorch, TensorFlow, Keras, or other Deep Learning frameworks
  • Understanding of advanced evaluation techniques in Machine Learning
  • Ability to implement efficient, clean, and scalable code preferably in Python
  • Ability to communicate professionally and explain research ideas to a cross functional team of Product Managers, Engineers and UX Designers.
  • Strong ML problem-solving skills, ability to do independent experiments (a self-starter mindset), but also collaborate in a team environment

If you are passionate about applying your experience in the AI/ML field to an emerging and advancing field of Generative AI , this is a great opportunity for you. You will get to work on a groundbreaking product poised to revolutionize the way companies approach LLM Evaluations. Join our team at Galileo and help us build the future of Evaluations in Generative AI.


Why Galileo

  • Join a seasoned founding team that has previously led product and engineering teams from 0 to $100M+ in revenue and from 0 to 1B+ users globally
  • We obsess over our team’s culture driven by inclusivity, empathy and curiosity
  • We invest in our team’s development and happiness because our employees are the keys to our success and ensuring happy customers – towards that end, we offer: 
    • Unlimited PTO 🌊
    • Parental leave for birthing or non-birthing parents – 100% pay for 8 weeks 🚼
    • Employee Stock Participation Plan 📈
    • Commuter Benefits 🚖
    • Mental and Physical Wellness 🧘
    • Company Paid Lunches 🌯
    • Headquarters Office in San Francisco 🌉 and a hub in New York 🌇
    • *Build the company with the Founders* 🧑‍💻


Related vacancies