Neo4j: How a lack of context awareness is hampering AI development
What do we mean when we say ‘context’? In essence, context is the information that frames something to give it meaning. Taken on its own, a shout could be anything from an expression of joy to warning. In the context of a structured piece of on-stage Grime, it’s what made Stormzy’s appearance at Glastonbury the triumph it was.
The problem is that context doesn’t come free – it has to be discovered. AI (Artificial Intelligence) designers are painfully aware of this and try to avoid the problem by building narrow, but powerful, systems that do one thing extremely well, but don’t scale horizontally and don’t offer really human-level understanding of complexity.
One increasingly popular way out of this impasse is by extending AI’s power with a graph database-based approach to working with complexity. If you’re not familiar, a graph database is a way of managing data that is different from the traditional relational database (think, Oracle or Microsoft SQL Server), but also other NoSQL approaches (as in MongoDB). Gartner identified enterprise interest in the technology as one of its top trends and, it’s the ’Year of Graph’, according to commentators. It also already has a wide variety of use cases, from Amazon-style shopping recommendations to fraud and money laundering detection.
And increasingly, graph software is being used to power AI and ML (Machine Learning). That’s because its in-built architecture provides that missing context for AI applications, which results in outcomes that are far superior to results from AI systems that don’t attempt to incorporate the background.
AI that can be trained to help us deal with fraud better would be a huge boost to global GDP. According to Stratistics MRC, the global fraud detection and prevention market was valued at $17.5bn in 2017 and is expected to grow to $120bn by 2026. There’s also been over 48,000 U.S. patents for fraud and anomaly detection issued in the last 10 years, so this is a critical issue.
To address this problem, financial services companies are looking to graphs to reveal predictive patterns, find unusual behaviour, and score influential entities, using contextual information loaded in Machine Learning models. Another use case is finding better automated ways to help fight the problem of opioid abuse in the US. The Association for the Advancement of Artificial Intelligence has piloted use of graphs to detect clusters of interactions between doctors and pharmacies to improve opioid fraud predictions, for example.
So if there is already AI technology which is adept at helping with specific, well-defined tasks, imagine if we also had AI that could do that but also handle ambiguity. We humans deal with ambiguities by using context to figure out what’s important in a situation, then extend that learning to understanding new situations. We need to assist the AI to be able to do that too – and in such a way that ensures the explainability and transparency of any given decision.
Context-supported AI also helps an AI’s human overseers map and visualise the decision path within the contextual dataset, removing the ‘black box’ aspect of decision-making that can reduce confidence in why the system reached the conclusions/recommendations offered.
Context-supported AI is potentially game-changing
My firm, Neo4j, is so convinced by the importance of graphs to AI, we have formally submitted a graph and AI proposal to NIST, The US government’s National Institute for Standards and Technology, which is helping to create a plan for the next wave of US AI government standards.
This consultation is about building trust in AI, so really matters: as the Deputy Assistant to the President for Technology Policy, Michael Kratsios, notes, “The information we receive will be critical to Federal engagement in the development of technical standards for AI and strengthening the public’s trust and confidence in the technology.”
Our proposal said that AI and related applications of intelligent computing, like Machine Learning (ML), are more effective, trustworthy, and robust when supported and interpreted by the kind of contextual information that only graph software can provide. Let’s take a serious AI issue to see why – ethics and unconscious bias in AI. If all we do is teach our computers to reason the exact same we do, with all our flaws and limited human biases, we will end up with systems that may redline and exclude or disfavour certain service users, or discriminate against some socio-economic groups.
As a result, it is our social, business and technical conclusion that context should be incorporated into AI to ensure we apply these technologies in ways that do not violate societal and economic principles.
AI standards that don't explicitly include contextual information will result in subpar outcomes, as solution providers leave out hugely valuable information. This is just one place where graph software, developed as a way to represent connected data and analyse the relationships in it, can step forward. That’s because graph technology can enrich any dataset to make it more useful, and as a better basis for any AI applications.
Graph technology could help any and all AI projects – and could help us all, as we become the beneficiaries of more sensitive, accurate and insightful computer systems of the future.
- Why AI and analytics are becoming critical to successTechnology & AI
- Employees think leaders are too slow to embrace new techDigital Strategy
- 12 top AI and ML trends for the enterprise in 2023 – DataikuTechnology & AI
- AI smart building platform Infogrid – CEO's 2022 predictionsTechnology & AI