Rfx-577 - Data Engineer Specialist

Required Education and Certification:

* Applicants must have a first level university degree in information security, computer science, engineering, mathematics, business or related discipline. 
* Certifications such as Certified Amazon Web Services (AWS) Solutions Architect, and AWS Certified Data Analytics Specialty are highly desirable.

Required Skills set:

• Expert knowledge and experience developing and implementing ETL jobs for data warehouses using SQL and Python. 
• Good knowledge of software development language and tools such as SQL, Python, Spark 
• Good knowledge and experience with AWS or Azure Big Data tools: Glue, Athena, Redshift, Kinesis, Data bricks, azure analytics, Data explorer. 
• Good knowledge and experience with cloud-based storage and functions. (S3, Blob, Lambda, Azure Functions) 
• Expert knowledge and experience of data engineering tools and methodologies (Datawarehouse, data lake, star schema). 
• Good knowledge and experience with AWS Cloud Formation or Terraform. 
• Knowledge of CI/CD concepts in general and AWS CodePipeline/ CodeBuild/ CodeDeploy in particular. 
• Knowledge of provisioning of data APIs. 
• Knowledge of information security concepts and terminology 
• Excellent written and verbal communication skills that are compelling, convincing and reassuring, with the ability to articulate complex technical ideas to non-technical team.
• Proficient user of Git. Familiarity with Jira and Bitbucket. 
• Experience in the implementation of, or demonstratable familiarity with the Gartner ODM framework would be an advantage.

Objective:

• The assignment is located in the Security and Information Assurance Division (SIAD). This Division is responsible for the management of all aspects of organizations’ information and physical security and safety and ensures that appropriate policies and procedures are in place and effective measures and controls are established to assess and mitigate threats/risks to the Organization. In particular, the Division defines the controls for the implementation of information security instruments and monitors if adequate assurance is maintained. The Division also provides professional safety and security services for our staff, its delegates and visitors and ensures the protection of the Organization’s facilities and assets. Appropriate balance of the roles between “service” and “control” is the key for its success in enabling and sustaining our operations in an environment with increasing demands for openness and connectivity on the one hand and rapidly evolving information security risks on the other hand.

• The project will deliver an aggregated data set that can be consumed by a data visualization tool such as AWS Quicksight or Azure Analytics. While the data is derived from various Information Security sources, the Extract, Transform and Load (ETL) process will use the capabilities and processes developed as part of the IP Portal Program. The IP Portal Program has a common analytics platform (hereinafter referred to as “IP Analytics Platform”), which aggregates multiple datasets. The project will enhance a Security Metrics data set used by SIAD based on the approaches and tools used by the IP Analytics Platform.

• The Data Engineering Specialist is primarily responsible for supporting the design and designing and implementing data pipelines, writing and testing transformations and deployment scripts.