Global IT Software Engineer Senior Manager - GenAI

Company: Boston Consulting Group Careers
Location: Boston
Posted on: September 2, 2024

Job Description:

WHAT YOU'LL DO
As a Global IT Software Engineer Senior Manager - GenAI, you will play a pivotal role in BCG's AI-driven transformation journey. BCG is committed to leveraging AI to enhance business operations and client solutions, and your role will be instrumental in this mission. You will contribute to the design, development, testing, and deployment of a self-service chatbot utilizing state-of-the-art technologies such as AWS Bedrock, industry-foundational language models, and LangChain. This chatbot will revolutionize IT support by providing efficient, AI-driven solutions.
You will assist in applying domain expertise in building and deploying conversational chatbots specifically for IT customer support. This includes ensuring the chatbot integrates seamlessly with IT Service Management tools such as ServiceNow. Your understanding of Service Desk processes will be essential in helping to optimize the chatbot to handle various IT support scenarios effectively.
In addition, you will participate in testing, evaluating, and fine-tuning prompts to ensure optimal chatbot performance. You will support the implementation of responsible AI practices and help establish necessary guardrails to ensure the chatbot operates ethically, reliably and effectively.
You will collaborate with cross-functional teams to support the successful implementation and integration of the chatbot. Your responsibilities include assisting in the development processes, contributing to the high-quality and timely delivery of solutions, and engaging with stakeholders for requirement gathering and project updates. Additionally, you will help identify potential risks and support the development of mitigation strategies to ensure the seamless deployment and operation of the chatbot.

YOU'RE GOOD AT

• Supporting technical projects and assisting development teams.
• Collaborating effectively with cross-functional teams and stakeholders.
• Problem-solving and critical thinking in technical environments.
• Communicating clearly and concisely, both in writing and verbally.
• Learning new technologies and continuously improving processes.
• Strong knowledge and experience in Generative AI/LLM-based development.
• Experience working with key LLM models APIs (e.g., AWS Bedrock, Azure OpenAI/OpenAI) and LLM frameworks (e.g., LangChain, LlamaIndex).
• Experience with cloud infrastructure for AI/Generative AI/ML on AWS, Azure.
• Hands-on experience with IT Service Management tools like ServiceNow, Remedy, or similar.
• Understanding of Service Desk processes and best practices.
• Ability to test, evaluate, and fine-tune AI prompts for optimized performance.
• Knowledge of responsible AI practices and implementing necessary guardrails.
• Bachelor's degree in computer science, engineering, or equivalent.
• Proficiency in at least two programming tools/languages (e.g., Java, C/C++, Python).
• Understanding of SDLC principles and software engineering practices.
• Familiarity with advanced algorithms, program structures, and API development.
• Skills in prompt engineering, automated testing, and debugging.
• Experience in cloud-native application development and CI/CD pipelines.
• Experience in building and deploying conversational chatbots for IT and/or customer support.
  YOU BRING (EXPERIENCE & QUALIFICATIONS)
  You will be a key member of the IT & Business Platforms (ITBP) team, contributing to the development of BCG's flagship GenAI use case for an IT support chatbot. This chatbot will be a critical component in transforming IT support through AI-driven solutions. Your team will work closely with the Cloud Platform Engineering (CPE) team, which is responsible for building the shared GenAI platform. This platform will support multiple GenAI use cases across the company, ensuring scalable and robust AI solutions. The close collaboration between ITBP and CPE will be essential for the successful implementation and integration of the self-service chatbot and other innovative AI solutions, driving BCG's broader AI transformation agenda.
  YOU'LL WORK WITH
  BCG's information technology group collaboratively delivers the latest digital technologies that enable our consultants to lead and our business to grow. For our IT jobs, we seek individuals with expertise in the areas of IT infrastructure, application development, business systems, collaborative and social technologies, information security, and project leadership.
  

Keywords: Boston Consulting Group Careers, Boston , Global IT Software Engineer Senior Manager - GenAI, Executive , Boston, Massachusetts