BigData/Hadoop Developer Job at Lorven technologies, Chandler, AZ

Q1YyMUtMWUIyK3hrOUpiMVRjQWxIRkJrVFE9PQ==
  • Lorven technologies
  • Chandler, AZ

Job Description

Role: BigData/Hadoop

Location: Chandler, AZ - 3 days a week in office

Duration: 24-month contract

Job Type : Contract

Job description:

We are seeking a proactive and accountable BigData/Hadoop with a minimum of 5 years of hands-on experience in building and maintaining scalable data pipelines using big data and cloud technologies. The ideal candidate will have strong expertise in data modeling, transformation, and automation, with the ability to work independently and troubleshoot effectively in a dynamic environment.

Key Responsibilities:

  • Design, develop, and maintain data pipelines using Hadoop, Hive, PySpark, and Python.
  • Integrate and manage data within AWS S3, ensuring security and performance.
  • Perform data modeling and database design to support analytical and operational use cases.
  • Schedule, monitor, and manage data workflows using Autosys.
  • Utilize Power BI and Dremio for data visualization and query acceleration.
  • Develop and maintain Unix/Shell scripts as part of the CI/CD pipeline.
  • Apply logic and transformations to large-scale datasets to meet business requirements.
  • Troubleshoot complex data issues across the pipeline and provide scalable solutions.
  • Collaborate with cross-functional teams to ensure data accuracy, quality, and performance.

Required Skills:

  • 4+ years of hands-on experience in:
    • Big data stack: Hadoop, Hive, PySpark, Python
    • AWS S3 storage management, security, and integrations
    • Job scheduling using Autosys
    • Data modeling and relational database design (e.g., MySQL or similar)
    • Shell scripting and CI/CD integration
    • Visualization tools like Power BI and Dremio
  • Strong problem-solving skills with the ability to analyze and resolve data issues effectively.
  • Self-starter with strong ownership, accountability, and communication skills.

Preferred Qualifications:

  • Exposure to Google Cloud Platform (GCP) for data engineering tasks.
  • Experience in financial services or other data-intensive domains.

Job Tags

Hourly pay, Permanent employment, Full time, Contract work, Part time, Internship, Seasonal work, Work at office, 3 days per week,

Similar Jobs

La Fontaine Restaurant

Waitress/Waiter Job at La Fontaine Restaurant

 ...Description Seeking professional Server / Waiter / Waitress / Wait staff with relevant experience. This is a very important role for us and we rely heavily on our serving staff. They manage the pulse of the dining room and ensure patrons have a memorable dining experience... 

KPC GLOBAL MEDICAL CENTERS INC.

Registered Nurse-Surgery, Per Diem, Varied Shift Job at KPC GLOBAL MEDICAL CENTERS INC.

 ...Director, Surgical Services POSITION SUMMARY : Provides for the surgical patients needs, by assessing, planning and implementing nursing care patient receives preoperatively, intraoperatively, and postoperatively. Nursing activities performed by the perioperative... 

TekWissen ®

SAP Performance Engineer Job at TekWissen ®

 ...programming languages ~ Strong knowledge of performance tuning of SQL queries ~ Experience with APM tools like Dynatrace, AppD and Splunk Top 3 skills required: Experience in SAP HANA Performance engineering Strong Performance Engineering background... 

American Kitchen Delights Inc

Food Safety & Quality Manager Job at American Kitchen Delights Inc

 ...Job Description Job Description About the Role: The Food Safety & Quality Manager will lead and oversee all aspects of food safety and quality assurance within the organization, ensuring compliance with regulatory standards and internal policies. This role is critical... 

Six Flags Discovery Kingdom

Scuba Diver $25/HR Job at Six Flags Discovery Kingdom

 ...holidays, and weekends. Must possess a valid drivers license and be able to operate vehicles (including but not limited to forklifts, golf carts, cars, trucks). Must possess an open water dive certification from a recognized agency. Must be able to work with...