Pyspark Developer With Python Or Scala

Minimum 5+Years of work exp…

Any Visa

Location: Remote

Job Description:
The software engineer who develops Python libraries
Develop Python and PySpark enhancements to an internal model execution platform that utilizes a custom set of interfaces
Communicate and direct model development teams on the implementation of statistical models
Interface with model owners and gather feedback on delivered analytical data.
Write specifications and documentation for Python interfaces
Communicate needed changes to other members of the development team
Work with QA team on test plan reviews and assist in QA testing process with requirements clarifications and questions
5+ Years of Python/PySpark Development
A software development background requires an understanding of fundamental computer science concepts needed including algorithms and data structures
Experience developing and packaging own functionality in Python that demonstrate an understanding of namespaces, environments & data structures in Python
Knowledge & experience in working within the Hadoop ecosystem
Experience in building and debugging PySpark jobs
Comfortable working in a Unix environment
Experience in source control tooling, preferably GIT
Knowledge of and experience in building RESTful interfaces
Experience in working with relational databases
Experience in developing in R is a plus

Job Type: Full-time

Pay: $40.00 - $50.00 per hour

Schedule:
8 hour shift

Work Location: Remote