About the company
Velvetech is an American global software development company headquartered in Miami, FL, and with an office in Chicago, IL. Velvetech has its developers strategically distributed in 10+ global technical job markets to deliver the best in class software engineering and exceptional client services. We have 20+ years of experience in software and hardware development for clients all around the world, especially for US clients. As an official Microsoft Gold Partner, our company is listed in the top 5 software development companies in Illinois, USA.
Responsibilities
- Develop and optimize MLOps pipelines for scalable model development and deployment
- Automate model training, deployment, monitoring, and testing workflows
- Manage data pipelines, ensuring efficient training data preparation
- Implement model performance tracking and versioning using MLflow
- Deploy and fine-tune open-source LLM models for various business use cases
- Utilize vLLM, LiteLLM, BentoML, Ollama for optimized LLM inference and deployment
- Monitor and evaluate LLM performance across different metrics including latency, accuracy, and cost-effectiveness
- Develop AI-based solutions for product category classification and product data enrichment
Requirements
- Deep expertise in cloud services such as Azure ML and AWS SageMaker
- Experience with MLOps and Cloud Services – Azure ML Studio, AWS SageMaker, MLflow, Databricks
- Containerization and Orchestration – Docker, Kubernetes
- Model Monitoring and Deployment – BentoML, Ollama, Hugging Face
- LLMOps Tools and Libraries – vLLM, LiteLLM, LangChain, Langfuse
- CI/CD and Workflow Automation – Gitlab, Azure DevOps