Adzuna logo

Big Data Developer III - IS Core Services

Location: Chennai
Company: Expeditors
Direct Employers
Apply for this job
"We're not in the shipping business; we're in the information business" -Peter Rose, Expeditors Founder
As a Fortune 500 company, Expeditors employs more than 15,000 trained professionals in a worldwide network of over 300 locations across six continents. Expeditors satisfies the increasingly sophisticated needs of international trade through customized solutions and seamless, integrated information systems. Our services include the consolidation and forwarding of air or ocean freight, customs brokerage, vendor consolidation, cargo insurance, time-definite transportation, order management, warehousing, distribution and customized logistics solutions. Expeditors is headquartered in Seattle, Washington.
"Velocity, Variety, and Volume" - those are three 'V's of the Big Data that our global logistics company, Expeditors, is handling daily while moving freight from all over the world. We invite you to an exciting opportunity to become part of a Big Data development team to help build a data lake environment and to support users through ingesting, analyzing, and visualizing Expeditors' Big Data. You will be working with highly skilled software development engineers using Event-Driven Architecture, Domain Driven Design, and Event Sourcing. If you are a data geek and excited about big data related technologies, we would like to talk to you about this great opportunity.
- Experience 12 - 16 years
- Leveraging and applying new and emerging practices for Enterprise Data Management utilizing Data Platforms
- Design, plan, and develop programs to perform automated extract, transform and load data between data sources
- Implement process improvements (Automation, Performance tuning, Optimize workflows)
- Develops and/or executes implementation according to the project plans and priorities
- Minimum 5+ years of professional software development experience.
- Object-oriented programming and component-based development with Java/Python.
- Experience working with both structured and unstructured data, with a high degree of SQL knowledge.
- Experience designing and implementing scalable ETL/ELT processes.
- Experience in modeling data for low latency reporting.
- Expertise with Big Data ecosystem services, such as Spark/SparkSQL, Kafka, Apache NiFi, Hadoop/Hive, MongoDB, HBase, and Kafka Streams.
- Experienced in Modern Big Data Analytics using Data Lakes, Spark, and different file formats like Avro, JSON, and Parquet.
- Experience working with large cloud data lakes.
- Hands-on experience with Databricks, building data pipelines.
- Performance tuning, troubleshooting and diagnostics, process monitoring, and profiling.
- Ability to work in a fast-paced environment with evolving requirements and capability goals.
- Appetite for learning new & emerging technologies.
- Strong problem-solving skills and communication skills.
- Self-motivated, driven, and independent individual.
- Prior experience with any cloud stack, preferably Azure.
- Prior experience with open source Apache projects.
- Understanding of reporting tools such as Power BI/MicroStrategy/Tableau etc.
- Experience with orchestrating complex data pipelines using tools like Azure Data Factory or Apache Airflow.
- Experience with large-scale data processing, complex event processing, stream processing.
- Experience working with CI/CD pipelines, source code repositories, and operating environments.
- Understanding containerization, virtualization, and cloud computing.
- Experience working in the Scrum Agile software development framework.
- Demonstrated expertise in Linux.
Manager, Core Services Portfolio
The position would be based in Chennai.
Apply for this job

Similar jobs

Big Data Developer III - IS Core Services
Chennai, Tamil Nadu
Cybersecurity Developer III - IS Core Services
Chennai, Tamil Nadu
Big Data Developer
8 - 17 lacs/annum
Big Data Developer
1 - 6 lacs/annum
GeakMinds Technologies Pvt Ltd