Work you will do
- Understand Big Data and Cloud environments from a performance and capacity management standpoint, using the tools needed to onboard, monitor and move bank’s data into these environments
- Collaborate with multiple technology groups and/or vendors to ensure that the appropriate associated applications, integrations, infrastructure, and security architecture are designed to meet evolving business requirements, meet standards for reliability, scalability, performance, and availability
- Responsible for the successful implementation of technical solutions for projects, supporting highly complex business applications with complex integration needs across multiple technology disciplines
- Formulate and define project scope, and objectives based on a thorough understanding of the technical requirements of the projects
- Use sound Agile development practices (code reviews, unit testing, etc.) to develop and deliver quality code and data products
- Provide day-to-day support and technical expertise to both technical and non-technical teams
- Work with other engineers to brainstorm solutions to problems and support bank objectives
- Build out scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of data sources.
Skills:
- Strong knowledge in Azure components, databricks, ADLS
- Spark Development experience using Scala, Java, Python, or SparkSQL
- Knowledge of Hadoop or Cloud Big Data ecosystem (Spark, Hive, HDFS, etc)
- Experience with streaming technologies such as Kafka and Spark Streaming
- Experience with Agile development (JIRA / Confluence)
- Experience with version control systems, such as Git
- Knowledge of dev tools like IDE’s, Maven, SBT
- Knowledge of orchestration tools like Airflow, Autosys, Oozie and Cron
- Experience with containerization (Docker) and orchestration (Kubernetes) is a plus
- Experience with developing and deploying applications to the cloud environment
- Strong knowledge of Linux and shell scripting
Who you are:
- Works well both individually and as part of a team
- Proven ability to work creatively in a problem-solving environment
- Strong communication skills
- Able to work closely with technical and non-technical team in a collaborative environment University degree in relevant STEM discipline (Computer Sciences, Electrical/Computer/Software Engineering and Mathematics) Financial institution experience is a plus