Pyspark Developer With Python Or Scala
Minimum 5+Years of work exp…
Any Visa
Location: Remote
Job Description:
The software engineer who develops Python libraries
Develop Python and PySpark enhancements to an internal model execution platform that utilizes a custom set of interfaces
Communicate and direct model development teams on the implementation of statistical models
Interface with model owners and gather feedback on delivered analytical data.
Write specifications and documentation for Python interfaces
Communicate needed changes to other members of the development team
Work with QA team on test plan reviews and assist in QA testing process with requirements clarifications and questions
5+ Years of Python/PySpark Development
A software development background requires an understanding of fundamental computer science concepts needed including algorithms and data structures
Experience developing and packaging own functionality in Python that demonstrate an understanding of namespaces, environments & data structures in Python
Knowledge & experience in working within the Hadoop ecosystem
Experience in building and debugging PySpark jobs
Comfortable working in a Unix environment
Experience in source control tooling, preferably GIT
Knowledge of and experience in building RESTful interfaces
Experience in working with relational databases
Experience in developing in R is a plus
Job Type: Full-time
Pay: $40.00 - $50.00 per hour
Schedule:
8 hour shift
Work Location: Remote