[Remote] Lead Palantir Foundry Data Engineer – (Pipeline Builder, Code Repositories, Workshop, Cloud) – 100% Remote

Note: The job is a remote job and is open to candidates in USA. Optomi, in partnership with a leading product manufacturer, is seeking a hands-on Lead Data Engineer for a direct-hire/permanent opportunity. This role is focused on designing, building, and maintaining business applications that leverage Palantir Foundry and modern Big Data technologies within a cloud-based environment. Responsibilities • Establish and maintain best practices in Big Data engineering for a Data Science and Analytics team, with a primary focus on Palantir Foundry pipelines. • Build and optimize data transformation pipelines to curate and report on enterprise-wide datasets (manufacturing, financial, and operational). • Lead a small team of engineers, acting as both hands-on practitioner and technical leader, ensuring successful delivery of advanced data solutions. • Partner with stakeholders to define data strategy, ensuring efficient data management, cloud adoption, and reporting scalability. Skills • Bachelor’s Degree in Computer Science or related field. • 6+ years of strong Data Engineering experience. • Hands-on experience with Palantir Foundry (data integration, transformation, ontology modeling, pipeline orchestration). • Expertise with PySpark and large-scale distributed data processing. • Strong experience with AWS cloud-based Big Data platforms and services (S3, Glue, EMR, Redshift, etc.). • Background in Hadoop-based technologies such as MapReduce, Hive, and Spark. • Proficiency in at least one programming language: Python or Java. • Solid understanding of ETL concepts, with hands-on experience in at least one ETL technology. • Experience with NoSQL (HBase, MongoDB, etc.) and RDBMS (SQL Server, Oracle, MySQL, PostgreSQL). • Familiarity with source control systems (Git) and CI/CD best practices. • Strong analytical and troubleshooting skills, with the ability to interact effectively with business and technical stakeholders. Company Overview • OPTOMI is an IT staffing firm that serves its consultants, clients, and employees through its consultant-focused approach. It was founded in 2012, and is headquartered in Roswell, Georgia, USA, with a workforce of 501-1000 employees. Its website is Company H1B Sponsorship • Optomi has a track record of offering H1B sponsorships, with 6 in 2025, 6 in 2024, 2 in 2023, 5 in 2022, 8 in 2021, 7 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job Apply tot his job