Data Engineer

My global financial client are looking for a Data Engineer to help deliver an ecosystem of enriched and protected sets of data - created from raw, structured and unstructured sources. My client has over 300 sources and a rapidly growing book of work. We are utilising the latest technologies to solve business problems and deliver value and truly unique insights. They are looking for Data Engineers that will work on the collecting, storing, processing, and analysing of large sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company and to help build out some core services that power Machine Learning and analytics systems.

Key Responsibilities: Data Engineer:

* Ability to process and rationalize structured data, message data and semi/unstructured data and ability to integrate multiple large data sources and databases into one system

* Proficient understanding of distributed computing principles and of the fundamental design principles behind a scalable application

* Strong knowledge of the Big Data eco system, experience with Hortonworks/Cloudera platforms

* Practical experience in using HDFS

* Practical expertise in developing applications and using querying tools on top of Hive, Spark (PySpark)

* Strong Scala skills

* Experience in Python, particularly the Anaconda environment and Python based ML model deployment

* Experience of Continuous Integration/Continuous Deployment (Jenkins/Hudson/Ansible)

* Experience with using GIT/GITLAB as a version control system.

Nice to Haves

* Knowledge of at least one Python web framework (preferably: Flask, Tornado, and/or twisted)

* Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3 would be a plus

* Good understanding of global markets, markets macrostructure and macro economics

* Knowledge of Elastic Search Stack (ELK)

* Experience with Google Cloud Platform (Data Proc / Dataflow)

Domain Knowledge:

* Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context.

* Knowledge of Trade Finance or Securities Services particularly useful.

* Knowledge of one or more of the following domains (including market data vendors):

* Party/Client

* Trade

* Settlements

* Payments

* Instrument and pricing

* Market and/or Credit Risk Need Experience using below languages/tools:

* Java

* HQL, SQL

* Querying tools on top of Hive, Spark (PySpark)

* Scala

* Python, particularly the Anaconda environment

* GIT/GITLAB as a version control system

Data Engineer

My global financial client are looking for a Data Engineer to help deliver an ecosystem of enriched and protected sets of data - created from raw, structured and unstructured sources. My client has over 300 sources and a rapidly growing book of work. We are utilising the latest technologies to solve business problems and deliver value and truly unique insights. They are looking for Data Engineers that will work on the collecting, storing, processing, and analysing of large sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company and to help build out some core services that power Machine Learning and analytics systems.

Key Responsibilities: Data Engineer:

* Ability to process and rationalize structured data, message data and semi/unstructured data and ability to integrate multiple large data sources and databases into one system

* Proficient understanding of distributed computing principles and of the fundamental design principles behind a scalable application

* Strong knowledge of the Big Data eco system, experience with Hortonworks/Cloudera platforms

* Practical experience in using HDFS

* Practical expertise in developing applications and using querying tools on top of Hive, Spark (PySpark)

* Strong Scala skills

* Experience in Python, particularly the Anaconda environment and Python based ML model deployment

* Experience of Continuous Integration/Continuous Deployment (Jenkins/Hudson/Ansible)

* Experience with using GIT/GITLAB as a version control system.

Nice to Haves

* Knowledge of at least one Python web framework (preferably: Flask, Tornado, and/or twisted)

* Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3 would be a plus

* Good understanding of global markets, markets macrostructure and macro economics

* Knowledge of Elastic Search Stack (ELK)

* Experience with Google Cloud Platform (Data Proc / Dataflow)

Domain Knowledge:

* Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context.

* Knowledge of Trade Finance or Securities Services particularly useful.

* Knowledge of one or more of the following domains (including market data vendors):

* Party/Client

* Trade

* Settlements

* Payments

* Instrument and pricing

* Market and/or Credit Risk Need Experience using below languages/tools:

* Java

* HQL, SQL

* Querying tools on top of Hive, Spark (PySpark)

* Scala

* Python, particularly the Anaconda environment

* GIT/GITLAB as a version control system

Working within the Financial Wellbeing Lab you'll play a pivotal role in the next stage of our transformation journey. The Lab's purpose is to create an industry leading experience to help our customers before, during and after financial difficulty. We'll ensure we help them become more financially resilient and improve their overall financial wellbeing.

We aim to achieve this purpose through improving colleague tools, creating solutions to allow customers to better manage their day-to-day finances, and by simplifying the Customer Financial Assistance systems through an increased focus on Test Automation, DevOps Cloud technologies and Rationalisation.

Our aim is to build a forward-thinking engineering culture delivering high quality, efficient and positive impact outcomes for our customers. The role of the Software Engineer is vital in ensuring the products we deliver are fit for purpose and meet the quality and standards that our customers expect.

What you'll do:

• Work in cross-disciplinary feature teams delivering exciting customer driven solutions and high quality software.
• Showcase excellent interpersonal and communications skills whilst efficiently working across the project life cycle to ensure software operates as intended
• Work in a highly collaborative way to complete assigned work, showcase progress and address problems that are well defined, complex and often non-routine.
• Continually develop with industry leading methodologies in order to advance the direction of Software Engineering in Lloyds.
• Work with Lab Engineer (& chapter) to ensure platforms and software are built consistently with relevant patterns and practices.
• Be a strong contributor to the Engineering Communities & Guilds, helping to build the community and building the capabilities of others

Key Experience

• Front end development - Enables us to build applications for the colleague & customer. Typically via the creation of the visual interface of an online or digital asset using JavaScript, HTML5, CSS or UI development
• Back end development - Makes sure everything works well for our colleague & customers and helps us use data in the right way. It is the coding of scripts in web sites and applications that interact with servers and databases so that their functionality is delivered to the end user. Typically we use c#, Mainframe (COBOL/JCL), SQL, Oracle/Unix and JAVA/CICS/DB2.
• Business Rules - This development brings to life the various functional aspects of our systems to drive interaction between our colleagues and customers and also support our colleagues in servicing customer needs.
• Agile Delivery - Agile delivery methods encourage teams to focus on collaboration, transparency, continuous improvement and the delivery of the highest value item first. It is useful when going after a complex problem that requires experimentation and continued adaption. Scrum is a key method we use which advocates a series of meetings (ceremonies) and activities known as sprints to help teams deliver change

Desirable

• Understand and direct how components and services are developed, tested and progressed within Chapters
• DevOps Knowledge - Helps us link our teams operating in agile delivery models with our operations teams who are running live services. Enabling us to create a culture of 'own what you build'.

Our group values of Keeping it Simple, Making a Difference Together and Putting customers First is at the heart of our ethos so a commitment to improvement, combined with adaptability, a love of learning, and a collaborative approach are key for us.

We're passionate about equal opportunities across all facets of our organisation. If you're self-motivated, passionate about delivering phenomenal solutions and interested in joining us at a critical and exciting time, then we'd love to hear from you.

Together we make it possible.

Working within the Financial Wellbeing Lab you'll play a pivotal role in the next stage of our transformation journey. The Lab's purpose is to create an industry leading experience to help our customers before, during and after financial difficulty. We'll ensure we help them become more financially resilient and improve their overall financial wellbeing.

We aim to achieve this purpose through improving colleague tools, creating solutions to allow customers to better manage their day-to-day finances, and by simplifying the Customer Financial Assistance systems through an increased focus on Test Automation, DevOps Cloud technologies and Rationalisation.

Our aim is to build a forward-thinking engineering culture delivering high quality, efficient and positive impact outcomes for our customers. The role of the Software Engineer is vital in ensuring the products we deliver are fit for purpose and meet the quality and standards that our customers expect.

What you'll do:

• Work in cross-disciplinary feature teams delivering exciting customer driven solutions and high quality software.
• Showcase excellent interpersonal and communications skills whilst efficiently working across the project life cycle to ensure software operates as intended
• Work in a highly collaborative way to complete assigned work, showcase progress and address problems that are well defined, complex and often non-routine.
• Continually develop with industry leading methodologies in order to advance the direction of Software Engineering in Lloyds.
• Work with Lab Engineer (& chapter) to ensure platforms and software are built consistently with relevant patterns and practices.
• Be a strong contributor to the Engineering Communities & Guilds, helping to build the community and building the capabilities of others

Key Experience

• Front end development - Enables us to build applications for the colleague & customer. Typically via the creation of the visual interface of an online or digital asset using JavaScript, HTML5, CSS or UI development
• Back end development - Makes sure everything works well for our colleague & customers and helps us use data in the right way. It is the coding of scripts in web sites and applications that interact with servers and databases so that their functionality is delivered to the end user. Typically we use c#, Mainframe (COBOL/JCL), SQL, Oracle/Unix and JAVA/CICS/DB2.
• Business Rules - This development brings to life the various functional aspects of our systems to drive interaction between our colleagues and customers and also support our colleagues in servicing customer needs.
• Agile Delivery - Agile delivery methods encourage teams to focus on collaboration, transparency, continuous improvement and the delivery of the highest value item first. It is useful when going after a complex problem that requires experimentation and continued adaption. Scrum is a key method we use which advocates a series of meetings (ceremonies) and activities known as sprints to help teams deliver change

Desirable

• Understand and direct how components and services are developed, tested and progressed within Chapters
• DevOps Knowledge - Helps us link our teams operating in agile delivery models with our operations teams who are running live services. Enabling us to create a culture of 'own what you build'.

Our group values of Keeping it Simple, Making a Difference Together and Putting customers First is at the heart of our ethos so a commitment to improvement, combined with adaptability, a love of learning, and a collaborative approach are key for us.

We're passionate about equal opportunities across all facets of our organisation. If you're self-motivated, passionate about delivering phenomenal solutions and interested in joining us at a critical and exciting time, then we'd love to hear from you.

Together we make it possible.