Research Intern - AI Frontiers - Agentic AI Models & Synthetic Data Generation

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.The AI Frontier Lab (https://www.microsoft.com/en-us/research/lab/ai-frontiers/?msockid=19a2ea5cb7556fe7274af9e9b6ef6eea) at Microsoft Research is seeking Research Interns to advance the state of the art in foundational model post-training, specialization and aligning models to Agentic AI capabilities such as reasoning and computer use. Our work spans both synthetic data generation and algorithmic advances in model training recipes.Our lab conducts cutting-edge research in artificial intelligenace (AI) and publishes findings in top-tier venues in AI and machine learning (ML), including NeurIPS, ICLR, ICML, and others. We release models and libraries focusing on small models (e.g. Phi-3 (https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/) , Orca (https://www.microsoft.com/en-us/research/project/orca/) ), synthetic data generation (e.g. AgentInstruct (https://aka.ms/AgentInstruct) ), and Agentic AI (e.g. OmniParser (https://aka.ms/OmniParser) , AutoGen (https://aka.ms/autogen) ). The lab also works within Microsoft's ecosystem to impact our AI-driven technologies in multiple products.We seek Research Interns with demonstrated ability for technical work and a proven record of influential publications on AI. For this role you should have a keen interest in developing synthetic data generation methods or training algorithms that enable models to take actions in a virtual world and reason more effectively, while maintaining computational efficiency.Research areas of particular interest for this team include, but are not limited to:

Developing methods to create high-quality data synthetically, with minimal human intervention.

Agentic systems for data generation, selection and filtering.

Developing novel training algorithms for enhancing reasoning and /or action taking.

Reinforcement learning approaches for improving logical and mathematical reasoning.

Exploring scaling laws between test-time and training-time compute.

Advanced optimization techniques for efficient training of large-scale models.

Our group takes a holistic approach to improving foundational models that includes a variety of data modalities (language, vision, multi-modal, and structured data) and modern model architectures.Priority will be given to candidates with a proven publication record in top-tier conferences, who have demonstrated the ability to develop original research and perform hands-on research, and who work well in a collaborative and dynamic environment.ResponsibilitiesResearch Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.Additional Responsibilities

Execute research directions that are at the forefront of innovation in AI.

Create synergies on joint, high-impact projects in collaboration with other researchers, engineers, and product group partners.

Work closely with other researchers in the teams on a research problem.

QualificationsRequired Qualifications

Accepted or currently enrolled in a PhD program in Computer Science or related STEM field.

Other Requirements

Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.

In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

Preferred Qualifications

Experience publishing academic papers as a lead author or essential contributor.

Experience participating in a top conference in relevant research domain.

Demonstrated ability to develop original research agendas.

Ability to work in a collaborative environment with multi-disciplinary teams. Active participation in the scientific community.

Well-established research record of publications in top-tier journals/conferences.

Hands-on experience with popular machine learning frameworks (e.g. pytorch, tensorflow, scikit-learn) and cloud platforms.

Experience with training and evaluating machine learning models for Natural Language Processing, Vision, and Multimodal tasks.

Experience with one data type is sufficient but candidates should be open to collaborating in projects that study a variety or a combination of modalities.

The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-intern-pay (https://careers.microsoft.com/us/en/us-intern-pay%C2%A0)Microsoft accepts applications and processes offers for these roles on an ongoing basis.Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .