Next Ventures
Data Engineer (Databricks preferred) - Edison
Job Description
Data Engineer (Databricks preferred)
Onsite contract in Edison NJ area (4x per week)
Long term contract: 3 year commitment
Rate: 80-100/Hour USD
Previous experience working in Finance, ideally Capital Markets, required.
We’re looking for an experienced Data Engineer to join our client's team and drive the development of cutting-edge data solutions. If you have a passion for optimizing big data pipelines, working with cloud platforms, and delivering high-impact insights, this role is for you!
What You’ll Do:
Design and build scalable data pipelines for seamless ingestion, transformation, and integration across diverse sources.
Develop and optimize Spark applications in Databricks to process and analyze large datasets efficiently.
Implement Delta Lake, data modeling, and cloud-based warehousing solutions.
Write clean, efficient code in Python, SQL, and PySpark to support data processing needs.
Work with structured, semi-structured, and unstructured data in event-driven and streaming environments.
Ensure high performance and scalability of Databricks workloads, while troubleshooting and optimizing jobs.
Enforce best practices in data governance, security, and compliance across cloud-based platforms.
Conduct code reviews to ensure optimal execution and adherence to industry standards.
Must-Have Skills:
Expertise in Databricks & Snowflake
Advanced SQL & Python development
Hands-on experience with ADF & PySpark
Strong Data Warehouse architecture & modeling knowledge
Preferred Experience:
8+ years of Python and SQL coding experience
ETL development using Databricks and PySpark
Familiarity with cloud data warehouses (Synapse, BigQuery, Redshift, Snowflake)
OLTP & OLAP, Dimensional Data Modeling expertise
Experience leading cloud data migrations and architecting scalable solutions
Cloud certifications are a plus!
Classet is a skilled trades network. Once you have applied, A Classet recruiter will reach out within 24 hours to learn more about your career search! Classet helps everyone from experienced crafstmen & women to eager apprentices find new opportunities. We are here to help you find the right fit for your career.