Position – Platform Architect
Experience – 12 Years
ROLE OVERVIEW & REQUIREMENTS
- Collaborate with enterprise architects, data architects, developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities
- Experience in service architecture, development, and high performance and scalability.
- Experience in Spark, Elastic Search, SQL performance tuning, and optimization.
- Experience with architectural design and development of large-scale data platforms and data applications.
- Good hands-on experience in AWS, Azure, OpenShift.
- In-depth understanding of Spark and their internal architecture
- Expertise on designing and building new Cloud Data platform and its optimization at organization level.
- Hands-on experience in Big Data technologies – Hadoop, Sqoop, Hive and Spark including DevOps.
- Strong SQL (Hive/Spark) skills and experience tuning complex queries
EXPERIENCE & SKILLS
- Experience – 12+ years
- Python, Java, Scala.
- Apache Spark
- AWS, OpenShift, Azure.
- PostgreSQL
- Elastic Search, Message Queue
- Microservice architecture
- File Format: Parquet, AVRO, CSV, JSON.
- Hadoop, Spark, Hive, HBase
WHAT WILL YOU GET?
You will be part of a rapidly growing Australian-based global company. You will be part of a team who are experts in enterprise data management, working in a company that has a 20-year history of delivering valuable client solutions.
You will have the opportunity to take your experience and skillsets to new levels We are an inclusive organisation that respects diversity. The contribution of our people is our greatest asset – we appreciate that and continually strive to provide an environment that encourages autonomy, mastery and purpose.
Apply for this position