Since its unofficial beginnings back in 2017, we’ve always kept a close eye on the “transformer revolution.” Along the way, our engineers have tested every iteration of Chat GPT released. At Klarity, due diligence is part of our cultural DNA. Nobody can predict when the next revolutionary change will arrive, so rather than rely on blind intuition we take a highly quantitative approach by testing new technologies often and thoroughly. When something surpasses our benchmarks, we implement it – and our process for testing ChatGPT was no different. The first version simply couldn’t perform at the level required for complex document review. Neither could the second iteration, nor the third. Then GPT-3.5 came along, and the results were immediately transformative.
So what changed? GPT-3.5 was based on a new underlying model, DaVinci-3, trained on wider datasets far more relevant to what we do at Klarity. A person can read everything on IMDB and Wikipedia, but that certainly won’t make them any good at reviewing contracts. The first three models simply didn’t have the contextual knowledge required to outperform the ones we had created internally. With GPT-3.5, the improvements were staggering. It excelled at document review, handled nuanced and complex language more intelligently, and was easy to modify to fit our requirements. Such instantly improved functionality meant customers would see significantly more value and at greater speed. It became clear we needed to incorporate it into the Klarity platform, and quickly.
Then last week, along came Chat GPT-4, which offers our customers all the promise of GPT-3.5 and more. GPT-4 has a deeper memory which provides more context, what is known as a multimodal AI. It is able to better interpret detailed questions, and its mathematical abilities are far superior. We found that GPT-4 readily beat GPT-3.5 in complex tabular extraction, and that it was able to seamlessly answer painfully detailed questions about lengthy documents with unprecedented accuracy. Its deeper contextual window is owed to an impressive token limit of 32,000, compared to a limit of just over 4,000 for GPT-3.5. This alone is a game-changer for use cases like the ones we serve, which involve extremely long strings of text. It offers new ways to engage with data, and embedded chat along with search. GPT-4 is also easier to modify, which allows customers to configure anything within Klarity simply by describing it to the system.
As a company that has been working to solve the same core problem for years, our fit with Open AI has been a natural one from the start – even if the tech hadn’t quite arrived at the station. Now that it has, Chat GPT essentially supercharges the one-of-a-kind capabilities that Klarity has already built, a layer that sits above countless hours of engineering work and decades of contextual data.
Our ability to generate data specific to the requirements of document review, when combined with the power of a Large Language Model like GPT-4, will create transformative outcomes for the organizations we serve. We have incredible access to rev rec and accounting data that has given us unparalleled insight and understanding of their use case. And our amazing engineers have long been steeped in the world of Natural Language Processing and LLMs. They possess an intimate understanding of how to bring those capabilities to value that has made integration both incredibly rapid and immediately impactful.
With Chat GPT-4 already integrated, the road ahead is boundless – and we don’t plan on driving in the slow lane. Speed is in our DNA, as evidenced by the fact that we shipped our own GPT 4 demo within a day of its launch, and we’re able to move at such an incredible pace due in large part to the futuristic work our engineers, builders and data scientists have done so tirelessly over the past several years. It is work that has put Klarity in the best possible position to leverage emerging innovations like ChatGPT, sets our customers up for immediate success and continual improvement, and allows us to deliver on our promise to make their lives better. In short, it was work worth doing.
To see what Klarity and GPT4 can do for you, check out our new GPT4 demo: https://demo.tryklarity.com/.
