Meet Amit and Subramanian, our dynamic software engineers in the Global Turner Limited team within Global Banking and Markets. Amit, an associate software engineer, began her journey with us as a summer intern, shining brightly and transitioning into a full-time role in 2020. With her flair as a full stack developer, she passionately crafts and elevates tools that supercharge our platform. Damian, a vice president who joined us in 2021, has been instrumental in building the vital backend components of our innovative new platform.
Legacy systems can pose challenges, but they also ignite our drive for innovation in the ever-evolving world of business technology. Our team’s equities processing system, which once thrived during its early years, now demands our creativity to adapt to the surging tide of data that accompanies business growth. Amid rising data volumes and increasing complexity, we recognized the need for transformation. By embracing the challenge, we paved the way for progress, facing the limitations of older technologies and inspiring ourselves to seek solutions for a brighter future.
Seeing these challenges as opportunities, we made a bold and strategic choice to create a cutting-edge framework. Inspired by a solution for distributed stateful stream processing, specifically crafted for unique scenarios, we set out to extend and generalize this vision. Our mission was to design a system that manages intricate data transformations and substantial transactional workloads while fostering adaptability and strength. This critical decision steered us toward tackling the legacy system’s challenges, enabling us to embrace a forward-thinking approach that fuels our ambitions.
The core of our legacy system—the essential data transformation—was fragmented and cumbersome, but we saw potential for greatness. Our groundbreaking framework, developed in Java, employs a declarative Model-to-Model transformation strategy. This transformation has yielded a cleaner, more intuitive system that invites collaboration among developers. Furthermore, this versatile framework allows transformations to operate independently from runtime technology, empowering us to leverage various streaming execution platforms like Apache Flink and Apache Spark. We champion robust exception handling and replay mechanisms for our Site Reliability Engineering team. To bolster our efforts, we’ve established a toolbox: web interfaces designed in React and TypeScript, backed by Spring Boot APIs for exception management, a graph-based lineage visual Emission of fields, and centralized monitoring systems to keep watch over our distributed pipelines.
Our new framework has ushered in unmatched flexibility and scalability—core traits necessary for adapting to ever-changing business demands. By facilitating low-latency, real-time data processing with incredible throughput, we are empowered to manage transaction surges seamlessly. This resilience has proven essential in the face of market volatility, where the ability to process data swiftly and handle errors is critical. Our improved operations enhance speed and stability, laying a robust foundation primed for future growth and discoveries.
For our talented engineering team, this journey was far more than a mere upgrade; it was a transformative experience teeming with opportunities. Engaging with this project has granted our developers exposure to pioneering technologies, while also providing a stage for ongoing learning and exploration. Our perspectives were embraced in decision-making, igniting our creativity as we contributed ideas that shaped the final product. The company’s dedication to nurturing growth shines through, offering access to inspiring learning platforms like Scaler Precipio and Pluralsight, which echo our engineering ethos: to keep learning and evolving. With such exhilarating projects and steadfast support, life in engineering here is vibrant and motivational—a realm where our skills flourish as rapidly as the technology we build. Plus, let’s not forget, the breathtaking view from our office adds to the inspiration!