Data Engineer Job at People Tech Group Inc, Washington DC

MFlnMG1mYk9TWFJoVW5ZVWZlWERpZ3EwNmc9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

Pyramid Consulting, Inc

Document Control Assistant Job at Pyramid Consulting, Inc

 ...Immediate need for a talented Document Control Assistant. This is a 12+months contract (+ Possibility to extend) opportunity with long-term potential and is located in Kansas City, MO (Onsite). Please review the job description below and contact me ASAP if you are... 

Central Admixture Pharmacy

IV Tech I Job at Central Admixture Pharmacy

Company: Central Admixture Pharmacy Job Posting Location: Aurora, Colorado, United States Functional Area: Pharmacy Working Model: Onsite Days of Work: Wednesday, Friday, Thursday, Tuesday, Saturday, Monday, Rotating, Sunday Shift: 5X8 Relocation...

CCL Label

Machine Operator Job at CCL Label

 ...Job Summary: A Machine Operator is a professional who is responsible for operating their assigned machinery. They ensure their machine runs smoothly, works at capacity without issue and is appropriately maintained. Duties/Responsibilities: Run various converting... 

LHH

Customer Service Representative Job at LHH

 ...partnering with LHH to hire a HYRBID, temporary Customer Service Representative for about 3 - 6 months. This role requires a 40-hour work week, Monday through Friday from 7AM to 4PM with a 1 hour lunch. The hourly rate is $25/hr. If this role is a fit to your... 

HarrisLaw

Office Administrative Assistant Job at HarrisLaw

 ...Innovative office assistant needed. Are you open to using technology? Top-rated law firm, HarrisLaw, managed by a Florida Bar board certified immigration lawyer based in Downtown Miami, Florida, is seeking an office administrative assistant who can effectively use technology...