Should GenAI Be More Accurate than Humans?

Introduction

At the recent #GenAI Week conference in Atlanta, I heard someone say, "Isn't it interesting that that we expect GenAI to be 100% accurate?" It led me to think more deeply about GenAI and why we think about accuracy greater than humans. At a very simple level, GenAI represents a mathematical algorithm trained on vast amounts of data generated by humans to predict the next word or sequence of words correctly. Humans are often incorrect and also have biases, yet we don't expect humans to be correct 100% of the time. Conversing with GenAI is a lot like having a conversation with an office colleague who provides valuable insights and context. While not perfect, I think an immediate benefit of GenAI lies in its ability to offer "pretty good" information that enhances our understanding and informs our choices.

Imperfect Yet Valuable Information

No information source is perfect, and GenAI is no exception. Like human experts, it can occasionally generate responses that are not 100% accurate. However, the information it offers is generally reliable and very useful. This level of accuracy is often sufficient for additional context when making decisions, especially when time is of the essence. Recognizing the limitations while appreciating the value is key to effectively leveraging GenAI.

The Power of Additional Context

One of the standout benefits of using GenAI is the wealth of additional context it brings to the table. Even when its responses aren't flawless, the broader perspectives and nuanced insights it provides can illuminate aspects of a problem that might have been overlooked. This enriched context aids in making more comprehensive decisions, allowing for a deeper understanding of the subject matter at a much faster rate than previously possible. Why ask one colleague when you can literally ask thousands?

Speed: An Unparalleled Advantage

In contrast to human interactions, where obtaining detailed information and context can be time-consuming, GenAI delivers extensive insights within seconds. By creating well-crafted prompts, users can access a depth and breadth of information that provides very rich context around a specific scenario. This speed does not come at the expense of quality; it enhances the efficiency with which valuable information is obtained and can lead to better decisions.

Enhancing Decision Quality and Efficiency

The ultimate goal of any decision-making tool is to improve the quality and speed of decisions. GenAI achieves this by providing substantial context that, while not perfect, is sufficiently accurate to guide effective action. By assimilating this information quickly, decision-makers can respond to challenges and opportunities more swiftly than ever before, with a better understanding of the situation.

Trust But Verify

• Never trust GenAI output implicitly. This is a critical guideline. It's important to approach GenAI outputs with a critical mind.
• Use your own intelligence and see if that output makes sense. Personal expertise and intuition are irreplaceable.
• Copy the generated output into a different GenAI tool and ask it to validate the output. Cross-referencing responses between different AI models can effectively identify inconsistencies or errors.
• Never forget the human touch and ask a colleague if they think it makes good sense. Human collaboration adds a layer of insight that AI cannot replicate. Colleagues offer perspectives or catch nuances that both you and the AI might have missed.
• There are many ways to quickly validate generated output to a level that you can trust. Quick validation methods reinforce the idea that efficiency doesn't have to come at the expense of accuracy.

Conclusion

Conversing with GenAI represents a significant change in how we can gather information and make decisions, especially when complemented by Internet search. It offers a unique combination of speed and contextual depth that, despite not being 100% accurate, can be immensely valuable. Professionals that embrace GenAI as a conversational partner, can enhance their decision-making processes, leading to better outcomes achieved more efficiently. In an era where time and information are critical assets, GenAI can be a powerful ally.