We Make Remote Work Remarkable • TopTalent from LatAm
Hello! We are GoFasti, a Talent-as-a-Service. GoFasti bridges the gap
between world-class developers and designers from LatAm and first-class
companies around the globe.
We need an English-fluent Senior Big Data Engineer , based in Latin
America, available to work remotely.
We are looking for someone with exceptional communication and relationship-
building skills, who embraces changes while maintaining strong attention to
detail. An interested and proactive person, who's constantly learning and
improving their skills.
Are you the one we are looking for?
Responsibilities:
- Design, build, and maintain efficient, reusable, and reliable PySpark code for processing large datasets.
- Develop Python, Shell Scripts to automate tasks and enhance data processing capabilities.
- Write optimized Hive queries for data extraction and to support analytics and reporting.
- Develop and optimize PySpark jobs for processing large datasets.
- Use Apache Airflow to orchestrate and schedule data pipelines.
- Collaborate with other team members and stakeholders to ensure the company's data infrastructure will support business requirements.
- Perform regular data audits to ensure data integrity and quality.
- Participate in design and code reviews, ensuring adherence to best practices.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5-8 years of experience in a Big Data role.
- Proficiency in Python and PySpark is essential.
- Experience with Big Data technologies, specifically Spark, Hadoop and Hive.
- Proven experience in Spark code optimization.
- Experience in processing large volumes of data, ideally terabytes.
- Experience with Apache Airflow and Control-M .
- Excellent problem-solving skills and attention to detail.
- Strong verbal and written communication skills.
Compensation:
- The Salary range offered for this position varies from (USD) $3,500 - $5,000 per month, depending on seniority and skillset.
- This position is for an independent contractor, through a payroll platform.
- The talent will work REMOTELY allocated at our client.
Here are the steps for this process:
Application review/approval > Screening interview with GoFasti's team
> We build and send your profile to our client > Profile
review/approval by client > Interview with the client > Hiring and
onboarding.
Once you apply for the job, our team will review your resume. If it meets the
requirements, we will contact you and move forward in the process.
Thank you!