AI/ML Developer
Key Responsibilities:
- Python Development: Utilize Python for data exploration, analysis, and development, leveraging libraries such as Pandas, Matplotlib, and Scikit-learn.
- NLP Expertise: Apply a deep understanding of natural language processing concepts, utilizing Hugging Face pipelines for tasks including text classification, generation, and entity extraction.
- LLM Frameworks: Build and implement semantic search, retrieval-augmented generation (RAG), and hybrid search systems using frameworks like LlamaIndex or Langchain.
- Prompt Engineering: Design and structure effective prompts for LLMs programmatically using APIs from OpenAI, Vertex AI, or Llama, and demonstrate familiarity with common prompt engineering patterns.
- Vector Databases: Leverage experience with vector databases such as PineCone, Qdrant, Vespa, or Weaviate to enhance similarity search and retrieval capabilities.
- NLP Evaluation: Utilize and understand common metrics for evaluating the performance of NLP models and RAG systems, particularly in retrieval and generation tasks.
- Collaboration: Work closely with cross-functional teams to integrate AI solutions into existing workflows.
Qualifications:
- Minimum of 4 years of experience in AI/ML development.
- Strong proficiency in Python and its data manipulation libraries.
- Proven expertise in NLP and experience with Hugging Face.
- Hands-on experience with LLM frameworks such as LlamaIndex or Langchain.
- Familiarity with vector databases and experience in similarity search.
- Knowledge of NLP evaluation metrics and best practices.
- Nice to have: Experience with Terraform for infrastructure management.