Senior Data Engineer
Neshent Technologies
Technology
On-site
Full-time
- Location
- Fulton County, GA
- Compensation
- Not disclosed
- Employment
- Full-time
- Posted
- Nov 5, 2026 (1 hour ago)
About the role
We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python, PySpark, Apache Spark, and large-scale data engineering. The ideal candidate will be responsible for designing and developing scalable ETL pipelines, implementing data processing solutions, managing data ingestion frameworks, and optimizing cloud-based data platforms.
What you'll do
- also involves technical leadership, data governance, and collaboration with analytics and business intelligence teams.
- Required Technical Skills Strong hands-on experience with Databricks, Delta Lake, Delta Live Tables, and Unity Catalog.
- Proficiency in Python, PySpark, Spark SQL, and Apache Spark.
- Strong experience in ETL development, data pipeline design, and data transformation.
- Knowledge of Hadoop, Kafka, Hive, HDFS, and Sqoop.
- Expertise in SQL, data modeling, and data warehousing.
- Experience with batch and real-time data processing using
- Kafka and Spark Streaming.
- Cloud experience with AWS and/or GCP.
- Strong understanding of data quality, validation, cleansing, and governance.
- Experience working in Agile environments (Scrum, Kanban, SAFe).
- Preferred Skills Scala / Scala-Spark, IBM DataStage, TIBCO. AWS S3, Glue, Lambda, Kinesis/MSK.
- Tableau, Power BI, Spotfire, OAC.
- Teradata, DB2, BigQuery, Mainframe.
- Git, data governance, and retention modeling. Roles