Software Engineer (Distributed & Parallel Processing)
HI Technology & Innovation has been supporting cutting-edge development and engineering innovative solutions in close partnership with our start-up and scale-up clients, for over 10 years. Join us!
We usually respond within a week
Does this sound like you?
⚙️ Looking for a short, sharp challenge in distributed systems?
Here at HI Technology & Innovation we're hiring a freelance engineer for a rapid project for our client, who're evolving a C# single-threaded vector DB POC into a parallelized prototype — with sharding, query orchestration, CLI/REST interfaces, and performance benchmarking.
It’s ~5–10 days of deep, hands-on building for someone who:
Speaks MapReduce fluently
Loves shaving milliseconds with clever algorithms
Can juggle IPC, distance metrics, and query merges in their sleep
Stack is flexible. You get to choose. Start ASAP. Remote.
If this appeals and leans into your existing skills, if you feel you can crush this for our client, then read on (and apply!)
About the Role
An ideal candidate will be an experienced Distributed or Parallel Processing Engineer to lead the development of a lightweight “controller + wrapper” layer that adds multi-instance orchestration, parallelism, and query merging capabilities to the current system.
This is a high-impact, fast-paced role ideal for someone with strong distributed systems thinking, advanced algorithmic knowledge, and a pragmatic, results-oriented engineering mindset.
What You’ll Tackle
- Design and implement a wrapper/controller layer around the existing single-threaded vector DB POC.
- Enable sharding and parallel loading of large vector datasets across multiple instances.
- Implement logic to dispatch and coordinate parallel queries, aggregate candidate vectors, apply a pluggable distance metric (e.g., Euclidean, cosine similarity, Manhattan), and merge and sort results before returning to the caller.
- Expose both command-line and REST interfaces to interact with the system.
- Output clear timing metrics to demonstrate speed-ups from parallel execution.
- Deliver a working, testable prototype—production-ready polish is not required.
What We’re Looking For
- A degree in Computer Science (or equivalent experience).
- Deep expertise in distributed computing and parallel processing, including MapReduce-style patterns, data sharding, and inter-process communication (IPC).
- Proven track record as a senior engineer who can work independently, move quickly, and deliver results with minimal oversight.
- Strong problem-solving skills and practical experience using advanced data structures and algorithms in production projects. (Please be prepared to describe examples of how you applied advanced algorithms and data structures in real-world projects.)
- Comfort working across multiple languages and runtimes. You are free to choose whatever tech stack (Python, C#, C, etc.) gets the job done fastest.
- Ability to clearly demonstrate and benchmark performance improvements.
Engagement Snapshot
- Timeline: Short-term, estimated 5–10 days of focused work.
- Start Date: ASAP
- Location: Remote
- Deliverables: Fully functional parallel prototype with CLI + REST interfaces, benchmark metrics, and sharded query support.
Ready to build something fast and clever? Apply now and help bring this proof-of-concept to life.
- Department
- Software Engineers (Offshore)
- Locations
- Multiple locations
- Remote status
- Fully Remote

About HI Technology & Innovation
Since we were established in 2012, headquartered in the United Kingdom, we have rapidly expanded to lead the way in technology partnerships, collaborating with numerous businesses worldwide.