Вакансія Data Engineer

Project Description:

Creating an "Advanced Intelligence Engine" that will be used for analyzing data in Data Lake to create insights (opportunities, leads, etc.) and transfer them to SFDC to be used by the sales team.

Responsibilities:

• Collaborating with Advance Analytics team
• Developing algorithms and 'Apps' based on input prepared by Advance Analytics team
• Pushing data to SFDC using existing objects (Sales prospect, Contact, Lead, Alert, Activity) based on existing specifications, ESB (BizTalk) for connecting the systems - APPs & SFDC
• Testing and quality assurance of developed solutions
• Release management
• Project documentation

Skills:

Must have:

• Fluency in Hadoop stack
• Cloud Architecture (Azure Data Lake, U-SQL, Azure Data Factory).
• Scripting Language: Python Developer Center (strong understanding or willingness to learn quickly)

Nice to have:

• Distributed Computing: Spark (PySpark, Scala), MapReduce.
• NoSQL (e.g. MongoDB, Cassandra)
• SQL (PostgreSql)

Conceptional understanding:

• Distributed Computing
• Understanding of ETL processes.
• Data: Structured/Unstructured.
• Databases (NoSQL vs. SQL).