Unlock the power of AI with Key Influencers

AI is nothing short of revolutionary when it comes to solving tricky problems. Anyone who has been using generative AI such as ChatGPT knows that it’s an order of magnitude more powerful than what went before. But as with any ground-breaking technology, AI takes some getting used to. 

Traditionally, we develop software to carry out tasks based on our own assumptions and knowledge. Now, AI is using data to provide better answers to our problems. It’s still our data, but the power of AI is such that it can make more sense of it than a human can. AI's ability to provide more accurate, data-driven solutions to our problems and opportunities is incredibly powerful.

AI: A new approach 

Let’s say your goal is to increase sales. Traditional marketing would tell you to define your target market using market research and then craft a message tailored to that audience. While this approach works, it’s not always straightforward and by necessity has to include some assumptions. 

AI, on the other hand, uses a different approach: it sifts through large datasets, identifying the segments that are most likely to respond to your message based on past behaviour. And that’s the difference: AI doesn’t rely on what people say they will do; it looks at what they’ve actually done.

It’s not so different to what a market research expert once told me long after he had retired: "Look at what people do, not what they say." That’s precisely what AI does—it analyses historical data to provide insights that are grounded in reality, not assumptions.

Get started with AI with Microsoft Power BI

We tend to think of AI as being expensive and requiring teams of data scientists. In fact, Microsoft Power BI is a great way of getting started. It includes several powerful AI visuals: Key influencers, decomposition tree, Q&A, and Smart Narrative.

The Key Influencers visual uses AI to pinpoint the factors that influence the metric you're tracking. Whether it’s sales volume, net profit, or error rates, the Key Influencers visualization can help you identify what drives your key business outcomes.

What Problems Can Key Influencers Solve?

The Power BI Key Influencers visual works by analysing data to uncover the factors that either increase or decrease your chosen metric. Here's how it works in a nutshell:

1. Identify your key metric – eg sales volume, customer satisfaction, or product defects.
2. Gather relevant data – collect information on various factors that could impact your metric. This could include customer demographics, process efficiency, or external conditions.

Data can come from existing process or created for the project, such as:

• To increase sales – which customer demographics can you identify?
• To reduce errors – which data are you already monitoring? What could usefully be added?
• To increase productivity – which factors might impact employee performance that are already known?

Get your data in shape

For AI to work its magic, your dataset needs to meet certain criteria. Fairly obviously, there has to be some possible cause and effect between your data. There's no value in adding observations that do not influence your metric. In addition:

• Data may be continuous (numeric) or categorical but each row must represent a unique case.
• Data must be clean with no errors, duplicates or outliers that could skew the results.
• Get as much data as you can – AI thrives on large datasets. At an absolute minimum, Microsoft recommends having at least 100 observations for any one factor and at least 10 observations for comparison purposes. But large datasets give better results.

What do the results reveal?

The Key Influencers visual ranks the factors that influence your metric based on their influence, helping you quickly identify the most important drivers. But here’s where it gets really interesting: the AI doesn’t just stop at general insights—it can also segment the data to reveal deeper patterns.

For instance, it might show that "large companies" drive higher sales, which you might already know. But Key Influencers goes further by identifying more specific segments, such as "large companies in France’s textile industry" having a particularly strong impact on sales. These insights are tough to uncover manually, especially when dealing with large datasets.

Next steps: put AI to work

The Key Influencers visualization is just one of many ways that Microsoft Power BI can integrate AI into your business analysis. However, getting your data ready for analysis is crucial for success in any machine learning project.

At Anatec AI, we’ve got a ton of experience in data wrangling and data engineering, ensuring that your data is clean, structured, and ready for powerful AI insights. We also create semantic models and measures, so your data is in the right format for visuals such as Key Influencers. If you want to learn more about how we can help you unlock the full potential of Power BI’s AI features, don’t hesitate to get in touch for a chat.

Data is the new oil

Almost 20 years ago Chris Humby coined the phrase “data is the new oil” and it has been repeated like a mantra ever since. “Data is the new oil” has come to define a generation of business thinking. Data has changed the way we think, and the way we pay for things. 

Chris Humby was a data scientist before we knew that we needed data scientists. He worked with Tesco and found value in a place where no one else had looked: the weekly shop. Back then, each unremarkable purchase of toothpaste or bread was just that - unremarkable. Today we know differently. We now recognise the value in data that shows, for example, the purchase of nappies. We know that it indicates a high probability of household with a baby. Which in turn means a high probability of tired parents likely to redeem coupons against toys or premium brand nappies. And conversely, there’s no point offering money off toys or nappies to households without young children. 

The result was the Tesco Clubcard which became a win-win for both consumers and Tesco. And, of course, Chris Humby didn’t do too badly out of it either. Together, they had struck oil. 

Data needs to be refined

As with many catchy sayings, there’s more than a grain of truth in what he said. Like oil, valuable data is often hidden and needs research to be identified as such. And like crude oil, data also needs to be refined to be made useful. There was investment and experimentation in the Clubcard project before it became the success we know today.

Where is your data hidden?

A lot has happened since then, including of course AI. Whilst AI was around 20 years ago, it was not in the accessible format it is today. Azure AI Services make AI models available on a pay as you go basis, requiring an understanding of software engineering rather than machine learning to implement them.

But a lot of valuable data is still hidden. Some companies have made big investments in data analysis,  but many have not. And almost all businesses have vast amounts of data in databases, spreadsheets, legacy systems, and many other places. This is data that no one has yet identified as valuable.

Competitive advantage in an AI world

In a world where AI makes general knowledge easier to access, competitive advantage will come from business-specific knowledge. That is, the knowledge that individual businesses or organisations have built up over time and is unique to their organisation and industry. This is company-confidential data that has value to decision-makers - provided it can be easily accessed when it’s needed. 

Consider the needs of a medium sized business or department that wants to make in-house data easily available to their people. In the past, this might have been done using a combination of induction training, on-going training courses, operating manuals, and data shared on intranets.

ChatGPT has shown us a friendlier way to access data. AI now makes it much easier to access company data in the same way. Azure AI Search provides functionality to augment large language models like ChatGPT with domain specific data, such as company knowledge bases or information held in a database. 

Azure AI Search

Azure AI Search enables advanced querying of different types of data. It has clever ways of indexing data, which enables better performance when querying the data. And it integrates with other Azure services to provide natural language processing. 

It is no longer news that data has value. Now the question is how business should use their corporate data to best advantage. Azure AI Services, which includes Azure AI Search, puts better data within the reach of more businesses.

If you want to explore what Azure AI services could do you for you, then get in touch. We are Azure software developers with solid experience of software engineering and data manipulation. And we’d love to help you find your oil. 

What can Azure AI Services do for you?

AI is revolutionizing industries worldwide. From automating customer service with ChatGPT to enabling early disease detection, the possibilities are limitless. But how can businesses unlock this power without employing expensive AI? That’s where Microsoft Azure AI services comes in.

Business leaders are rightly focused on results, not building AI models. Azure AI services let you integrate powerful, pre-built AI capabilities into your business applications without requiring a team of specialists or a deep knowledge of machine learning.

Azure AI services offer pre-built, easy-to-deploy AI models that can be provisioned through the Azure portal, just like adding a database or virtual machine. Capabilities like image analysis and document intelligence are now available to anyone who can see an opportunity to improve a business process. Azure AI services make it much easier to turn a good idea into a better business.

Azure AI Services include Language, Speech, Vision, Content Safety, and more. For example, Azure AI Language enables sentiment analysis, key phrase extraction, and summarization—helping you better understand customer feedback and improve decision-making. Some Azure AI services can be customized, allowing you to develop innovative solutions to address specific challenges. You might want to improve customer experiences or streamline operations. And with a pay-as-you-go pricing model, building a proof-of-concept application is low-risk.

Azure also provides a comprehensive suite of tools—such as storage, app services, and containers—that support AI-powered application development. Now, instead of needing AI experts, we can use Azure software engineering skills to create powerful AI solutions.

With Azure AI, businesses of all sizes can tackle challenges and seize opportunities in ways that were once only possible for larger organizations.

If you are ready to explore the potential of AI in your business, contact us now to find out how we can help. We have the Azure software development skills needed to incorporate Azure AI services in ways that could transform your operations and drive innovation.

Retrieval Augmented Generation

I’ve got a riddle for you. When is ChatGPT not the best thing since sliced bread? Answer: When it makes things up! 

What? You didn’t think that was funny? Well, if getting things wrong is a big deal in your work, you can be forgiven for not rolling on the floor laughing.  

There are many industries where it’s important to get things right such as software development, renewable energy, science, medicine, education, government, or any other knowledge-intensive field. In all these areas, people depend on having timely and correct information to do their work and advise their customers.

What are “hallucinations” in LLMs?

Large language models (LLMs), such as ChatGPT and others, have revolutionised the way we interact with information. But despite the impressive communication skills of LLMs, they do have some limitations, such as making things up, also known as hallucinating. It may not happen very often but for some businesses and organisations, it's a big deal.

Hallucinations include generating information that is plain wrong, providing information that’s not relevant, or attributing things incorrectly. But why do they happen? And are the LLMs actually making things up? 

LLM hallucinations often occur because of gaps in the training data. When the question is specialised, relating to a niche area, or outside the time period of data for the training data, the LLM may lack the domain-specific sources and so helpfully does the best it can. 

Sometimes the response is obviously wrong, but often the response is highly plausible. And if the person requesting the information doesn’t have specialised knowledge, they may well think the answer is correct. This is the point where the riddle becomes even less funny than it was to begin with. And it wasn’t very funny even then ….

How Retrieval Augmented Generation (RAG) helps

RAG is the process of optimising large language models (LLMs) for specific knowledge-intensive tasks. The “augmented” in RAG is the process of supplementing the data available to the LLM with additional, domain-specific data. This may be internal to an organisation, or specialist data for a particular sphere of knowledge. It might include searching databases and selected documents. It means that the LLM has access to more recent and more specialist data. Which means that hallucinations become less frequent, and relevance and accuracy are increased for that particular area. And by making verified company-specific data available to the LLM, there’s massive business benefit.

Why RAG matters to business

As our world becomes more complex, so does our need to manage information. In industries like software development, manufacturing, or renewable energy, accurate and reliable information is crucial. By integrating RAG into your business processes, you’re giving your teams better data for decision-making, customer service, and product development. RAG provides a way for organisations to improve their products and services by harnessing AI in a way that’s tailored to their needs. 

Ready to leverage RAG in your business?

The first step in creating a RAG solution is identifying and collecting relevant content ready for indexing. If you’d like to discuss a proof-of-concept project for your business, we’ve got the relevant skills to tailor a solution to fit your specific needs. Get in touch to see whether our skills are a good fit for your goals. 

Is your data AI ready?

Intelligent data: what it is, and why it matters

I know a lot of people are wary of AI. The idea that software might make better decisions than lawyers, scientists, or doctors takes a bit of getting used to. But AI is already improving the world in wonderful ways. 

AI is processing images to improve scientists’ understanding of wildlife populations. Advanced research shows that AI could do a better job than some doctors of identifying eye problems. And AI is already analysing documents to provide lawyers with relevant case histories.

None of this is science fiction. These are real projects that are reducing costs, improving accuracy, and removing repetitive tasks from highly skilled people, freeing them up to do more valuable and interesting  work. 

Whilst we marvel at the intelligence and friendliness of ChatGPT, many businesses executives are trying to figure out how best to use AI to stay competitive.  The irony is that answer may be surprisingly simple.

1. Learn about AI: what it really is, how it works, and why it matters in your industry.
2. Bring data together: AI works best on large volumes of trustworthy data. That means you need to bring disparate data sources together into one unified and secure data platform. 
3. Get your data in shape. Clean it up. Match different data sources. Remove duplicates. Have an audit trail so you can trust the output. Add meta data. 
4. Rinse and repeat. Put processes in place so new data is added and cleaned ready for analysis. 
5. Make it visual. Microsoft Power BI has AI capabilities that make it much easier to visualise data, and to find data insights. 

AI is a disruptor, there can be little doubt about that. But figuring out how it will disrupt specific industries is more difficult to predict. But businesses who use data to uncover insights, and help their people make better decisions are outperforming those who do not. But everyone has to get started by understanding what the opportunities might be, and prototyping the possibilities.

Microsoft and the Azure intelligent data platform is a leader for Analytics and Business Intelligence platforms. From Power BI, Microsoft Fabric, to Azure SQL Database and CosmosDB, there’s a data platform to meet data needs large and small. 

If you are thinking about your next steps into an AI-powered world, get in touch to see whether our data engineering experience could help.