Data Engineer Sr

Who We Are

PALO IT is a global innovation consultancy and Agile software development company dedicated to helping organizations embrace tech as a force for good. We work with clients to rapidly launch products and services, create new business models, leadership and culture for the future. We are a community of innovators, designers and technologists across 10 offices and five continents (France, Spain, Hong Kong, Singapore, Thailand, Australia, Mexico, USA, Brazil and Colombia).

We're committed to helping businesses transform our world for the better. We're proud to be a World Economic Forum (WEF) New Champion, and a B Corp- certified company in México, Singapore and Hong Kong, currently working towards certification across all other locations.

**Our Impact in PALO IT **

Using our B Corp certification and WEF status as our north star, we’re eager to adapt to change, learn from our experiences and move to meet our planet’s urgent needs. With 2025 as our horizon, we are taking action to meet the following objectives:

• Become a climate net-zero company
• Attain 50% of revenue from projects with a positive impact
• Train 100% of our workforce on impact
• Achieve B Corp certification among all 11 of our offices across the globe
• Attain 90% happy employees at PALO IT

Our clients are amongst the world's most successful companies. We innovate with both established Fortune 1000s, SMEs and start-ups who aim to make an impact, become global leaders and address the world's most complex challenges.

What does your job look like?

As a Data Engineer, your main goal is to support and enhance a data-driven culture throughout the organization. You will collaborate with the Decision Science team to build solutions that enable teams to explore large datasets, experiment with and validate hypotheses, develop and optimize machine learning models, and use these models for real-time parametric decision-making. Additionally, you will contribute to the maintenance and development of the data flow on our Big Data platform. You will be responsible for designing, implementing, and optimizing data solutions using a variety of advanced tools and technologies.

Your main responsibilities will be to

• Maintain and develop the data flow on the Big Data platform.
• Design and build robust and scalable data pipelines.
• Integrate and manage large volumes of data from various sources.
• Develop and optimize data processing jobs using Hadoop, Spark, and other related tools.
• Configure and maintain workflow orchestration tools like Apache Airflow.
• Ensure data quality, integrity, and security.
• Collaborate with multidisciplinary teams to identify data requirements and provide appropriate technical solutions.
• Document processes, architectures, and data flows.

What you need to succeed on this rol

• Degree in Computer Science, Computer Engineering, or a related field.
• Demonstrable experience using Hadoop, Sqoop, Spark, Airflow, Avro, Python, ELK, Oracle Database, PostgreSQL, and Hive.
• Strong knowledge of relational and non-relational databases.
• Experience in implementing and maintaining data pipelines in Big Data environments.
• Programming skills in Python.
• Knowledge of log monitoring and analysis tools like ELK.
• Ability to solve complex problems and work independently and as part of a team.
• Good communication skills and ability to document technical processes.
• Advance english B2 or above.

Desirable Qualifications

• Previous experience in technology companies or Big Data projects.
• Familiarity with agile methodologies and project management tools.

**You're aligned with our value by: **

• Your willingness to do the right thing even when facing adversity
• You care about the well-being of others and the world at large
• You strive to approach things in a optimistic way
• You nail the fundamentals, sweat the details
• You understand the whole is more than the sum of its parts and actively work towards continuous improvement of the group

**What We Offer **

• Stimulating working environments
• Unique career path
• International mobility
• Internal R&D projects
• Knowledge sharing
• Personalized training
• Entrepreneurship & intrapreneurship

Discover more about us

- With our PALOCast with direct testimonies from our Palowans!
- More on our team culture and benefits in our careers page.

_PALO IT is an equal opportunity employer that values merit, qualifications, and abilities. We prioritize privacy and data security. For more information on our privacy practices, please refer to our _ Privacy Policy .