José Miranda

jmdm

Data Engineer - Xpand IT

Analytics Assessment: how to analyse a project’s viability

5-SECOND SUMMARY:
  • Discover the importance of carrying out an Assessment before implementing an analytics solution in your business;
  • An Assessment has several benefits, such as saving time and money and discovering challenges and answers for your analytics project.

Why should you do an Analytics Assessment?

Making the best of an analytics initiative can sometimes be a big challenge. Much is said about the action, but it’s the ‘discovery’ phase that will potentiate the success. Laying down a strategy isn’t that simple but comes with a lot of benefits that many cannot initially see. Discovery is the first stage of the process, where we define our data strategy and good practices and procedures to diminish the risks, time and costs associated with any transformational initiative such as a data project. To achieve this, an assessment should be performed to understand what we will need, what we can define and what must be done. But what are the main benefits of this?

Benefits of an Analytics Assessment

1. A personalised solution

The assessment is where the technologies and architecture for the project will be defined. This is true whether you’re starting from scratch or evolving from an already existing analytics solution. Analytics solutions can be created in many ways, depending on their specific goals. For example, is the system for internal use, or does it also need to communicate information to external stakeholders? Do you have near real-time use cases, or are they batched, etc.? Decisions are taken from a high-level perspective at this phase. Instead of settling for a general solution, decision-makers can personalise how they want things done, using the right tools for individual needs and problems. During this process, you will also define the necessary frameworks, used to accelerate the implementation and deployment of the project, granting quality standards.

2. Save money and time

The truth is, you end up having to make these decisions anyway, and the problem is that if you don’t make them in good time, you won’t make good decisions, and later on, making them out of necessity, the effort will have become much greater. This is because when you start a project without the right guidelines, once you define them, you find yourself having to revise everything that has already been implemented. Working like this, the chance of failure or forgetting something vital is enormous. Your teams will be held back fixing daily problems and become overworked and less focused on establishing best practices. In the end, you’ll feel that you can’t see the wood for the trees!

So, basically, when you embark on a project without proper planning in place, you do run the risk of finding that the process becomes far less efficient, even jeopardising the success of your analytics solution. You’ll have to spend unnecessary time and money re-engineering processes and due to not initially establishing a strategy, you will potentially come up with a solution that won’t even effectively address your requirements. Making a thorough assessment is done exactly to prevent such situations.

3. Know each other

An analytics solution always involves different stakeholders, most likely including multiple business departments such as IT, the management team and analytics specialists. Assessment opens the possibility of connecting all the intervenient parts. In the process, you’ll get to know what the perspective of every one of them is and define the best strategy and milestones so that, in the end you get an analytics solution that meets all expectations. The idea is to build a trust relationship where people work together towards a common goal from the ‘get-go’.

Final thoughts

An analytics assessment isn’t just a questionnaire; it’s a dialogue that will guide you towards the best approach for your goals. The benefits of this stage will prevent you from taking bad decisions and losing time defining strategies or processes during implementation or deployment. Besides this, by delaying implementation just a little bit longer, you will be able to start your project smoothly and effortlessly, with processes defined, risks highlighted, and solutions already prepared to mitigate likely problems to emerge from those risks. In the end, everything will be much more effective, and most importantly, you will build a robust analytics solution to enable you to get more value from your data.

José MirandaAnalytics Assessment: how to analyse a project’s viability
read more

7 key steps to implement a BI Strategy

5-SECOND SUMMARY:
  • There are 7 steps to implement a BI strategy in your company: Vision, Sponsor, Tools and architecture, Talent, Culture, Governance and Security and Evolution.

Nowadays, the market is highly competitive meaning that having a good BI strategy is the first step to achieving results and mitigating failures or wrong directions that can make you lose position or competitiveness.

Making a BI strategy is very important, especially when you’re going to implement it for the first time. There are some challenges and pains while doing it as some variables that you must take care of to prevent you from failing while implementing such a solution. It’s not easy to achieve a perfect implementation, but it’s not impossible, and we’re here to show you. Just follow the steps below, and we’re sure that you will perform great:

1. Vision

We would suggest that first of all, you must identify in which state your company is. How are you treating data? Where does it come from? Which processes and tools are being used? And which human resources can you take advantage of that have expertise in data?

After that, set up your priorities, objectives and goals that will bring value to your company and help achieve the better performance you’re seeking. Think of building a BI roadmap with future actions, milestones, deliverables and KPIs over a certain period, this may help you identify what is essential and the timelines for achievement.

2. Sponsor

Adopting a BI strategy will require resources and change management, and for this, you’ll have to find a sponsor for it inside your company, and that choice can be crucial. First, it will fund the change you want to implement in your company and second, you need someone inside your company to trust your work and support the project. Ensure that you involve your sponsor often, so he keeps trusting in your work and sees the results.

3. Choosing tools and architecture

There are pretty good BI tools out there in the market. But still, each of them has its advantages and disadvantages. Choosing a not so well fitted tool will make you lose money and time. Identify what will be the main patterns of your BI project. How and where will you fetch data, which type of treatment will data need and where will you store it after being cleaned, will you need more tabular analysis or charts analysis, and where do you want end users to access data and analysis.

These are some questions that you must answer first and after that search for tools and ask for demos so you can see the utility of those tools and if they fit what you want to do. Besides that, you must ensure that you have the right architecture for all the tools you need to use. If local machines or cloud, their performance and interconnection, which tool will do what and how will each of them connect to each other so the flow can be smooth and without major problems, and many other questions you can ask. A way to know the best tools in the market is by following the Magic Quadrant of Gartner published yearly.

4. Gathering talent

One of the most challenging points will be this one. Choosing roles and finding people to fill those spots, especially in a company that is not data-driven yet, will be hard to do. You can hire new people with data knowledge but who know nothing about your company, or you can take advantage of those you already have and simply train them. Maybe in the end it will be a mix of the two.

Implementing a BI solution requires different skills and specialisation so matching the internal resources with a partner is likely a good option.

5. Promoting Culture

If I said that the previous point would be one of the most challenging, this one would be equally hard. If a company is not data-driven or at least people don’t understand that things have to change and they must know how data works, then your project will fail. No one will be motivated to use BI tools because they won’t get anything from them; they won’t understand the purpose and value of such, something that in the end, will make them boycott the change you’re trying to implement. Make sure, from the start to yourself, your sponsors and all stakeholders that everyone must be trained, and ensure that you deliver data literacy and digital competencies to everyone in your company. Democratise data, let business users answer their questions and do analysis by themselves. Don’t just tell them the value of it; let them touch and see the future, and make them follow and want more.

6. Governance and Security

Data is something of great value but is something private too. You must ensure that your data is protected and only accessible to the ones that are allowed to access it. Assign people like data stewards or content administrators to check if all data is well stored and governed. Build policies and procedures for different scenarios, and guarantee that you are prepared for any leakage and data protection. You can extend this to your tools, and see how they are performing over their lifespan, if they are updated or if there are any improvements to them.

7. Evolve

Always believe that there’s no ending to what you’re doing. Data platforms are continuously evolving, and you must do the same; you can escalate your BI solution to use tools with Machine Learning or Artificial Intelligence capabilities in the future. Never forget that nothing is forever so always keep informed about data tendencies. Besides that, you won’t implement a BI solution to your whole company at the start, it will be for one department or one problem, so after being successful you may escalate BI to other departments or other problems where it may fit so that one day, you can call your company – a data-driven company.

Final Thoughts

As you see, implementing a BI solution will have its challenges, but you know as we know that it’ll be a game changer for your company. You’ll need a lot of perseverance, patience and know-how to manage conflict and expectations so that, in the end, the result may be on time and bring value to everyone and that’s why Xpand IT can help you with our service of the data journey. Besides that, we have teams highly specialized in these types of solutions which can advise you right from the start and bring all the necessary know-how.

José Miranda7 key steps to implement a BI Strategy
read more

Is my company Data-Driven? How to check your Analytics stage

This is the million-dollar question, in fact, for some companies, it could mean more. While pursuing the goal of becoming a data-driven company you can acknowledge the power of data to help you make the right decision at every point in time. But, how do you know if you’re on the right track? Happily, there are a lot of indicators and information to help with this evaluation. Knowing what stage your company is at can help underline what you must do to achieve the coveted ‘data-driven’ title. This leads to acknowledging what it takes to get there from different angles: how much effort is needed, how much in the way of resources must be spent, or even what competencies could be missing. In the end, the idea is to efficiently implement this process and become more competitive.

1. How much do you know about your data and who needs it?

To take advantage of analytics it is important that you know how data will be inputted and what data is available. How is data stored for the main areas of information that you need to work with – in files like Microsoft Excel or text, or contained in databases? How are these sources accessed nowadays? If you can answer these questions, then you have a good understanding of the data available.

Another aspect is knowing whom that data will be relevant to, who your end users going to be and in what contexts they will access that data. For instance, if one of your objectives is to get mobile access to content or data stored in the cloud, you need to know if your company has these resources. Find out which technologies are being used now and list the technologies you may need in the future to support the whole process.

2. How focused is your team on becoming a data-driven company?

When a company wants to go down the data-driven route, its people must be oriented that way too. Every disruptor must have sponsors, normally executives, who are open to change and who understand and believe in the benefits of the project. These internal sponsors will be responsible for ensuring that business processes frequently include data analysis and act as enablers. Make sure that your leaders are ready too and have the skills to embrace transformation. Find data champions, people who can work with data tools and share their knowledge with other end users.

It’s no use investing in a new process like this if you’re not committed to changing everyone and persuading them towards a digital and data mindset. If you want your company to be data-driven, you must spread the ideals, but don’t try to do it alone, believe in everyone’s capabilities.

3. Does your company have all the necessary skills?

Implementing an analytics platform will require different areas of expertise, ranging from data engineering to visualisation and even setting up infrastructure. Besides this, users will need training and regular workshops can help drive adoption.

Start by checking the proficiency of your end-users, whether you have an analytics department if there are any data champions and what skills are available. Implementing a data-driven path without specific skills will be very hard and may take ages to achieve. You can even jeopardise the whole process if you don’t anticipate user needs or simply don’t have enough quality data and undermine the confidence in analytics.

This is something hard to recover from because everyone must feel that it’s easy to interact with the platform and for this, they must be well trained and have a super-cool infrastructure where they can easily access these new functionalities without problems.

4. How can everything be governed and secured?

Last but not least, after analysing where your company culture is headed, after evaluating the data available and after defining all the players who will be involved, you must check how security is achieved and content is being governed. Is information divided by department or is it all held centrally to be accessed by all users? What can someone with a specific role view do? Will they only see specific information or be able to access all your content? These are examples of some of the questions you must look at.

Nowadays, low-code modern BI (Business Intelligence) tools like Microsoft PowerBI and Tableau have features and capabilities that satisfy these issues, which makes the job easier. With them, you can give freedom to your users to do whatever they want; see, edit and share content, etc., but always governed by what you decide they are able to do. In many cases, especially for larger companies, data is accessed to build dashboards with content that can be shared to specific roles across the whole organisation. Without a good governance model, it’s really hard to achieve a streamlined process where content is quickly accessed, updated when needed and safely shared.

Final Thoughts

Sometimes it’s hard to evaluate what stage your company is at, and this is why today we are giving you some insights and advice. The term ‘data-driven’ is becoming ever more popular and better understood in the business world, but many companies don’t know where they stand and what they should do.

The actual steps you need to take to become a data-driven company will depend on your unique organisation set-up and where you currently stand. We want you to know where you are, what you have and what you need to do, and this is why Xpand IT created the Data Journey concept, detailing all the steps required for success. We can help you evaluate, design and deploy a sustainable initiative to pursue and achieve a data-driven culture, making sure you have all the necessary skills available and someone with a high level of expertise assessing your needs. The objective and final outcome are to promote the success of one of the most important aspects of your company’s digital transformation.

José MirandaIs my company Data-Driven? How to check your Analytics stage
read more

Cloud Analytics solutions with Synapse

5-SECOND SUMMARY:
  • Microsoft Azure Synapse came to change the game: companies can now be more agile by centralizing analytics work in one place;
  • In this article, we’re going to focus on the SaaS solution for implementing a full Azure BI solution.

Cloud solutions and in particular Software as a Service (SaaS) bring several advantages such as how easy it is to get started, and all the features available enabling us to be more agile and cope with business changes. In this article, we’re going to focus on the SaaS solution for implementing a full Azure BI solution. Azure SaaS solution would mean your users would access all their work on the internet through a provided website or app instead of installing them on local machines as we’re going to see.

So how would that work? Everything begins in the same place as always – data sources and databases.

1. Storing data with Azure Data Lake Storage (ADLS)

After you define where your data comes from, you’ll see that some of it come from databases that you may have already, files or other data sources. For that, you have Azure Data Lake Storage, which is like a cloud file system where you can store any object you want. It is very easy to integrate with platforms and programming languages, giving it the capability of storing data coming from anywhere and establishing security.

In short, Azure Data Lake Storage lets you have all your data sources integrated into one place, storing them together and building your data lake.

2. Processing data with Synapse

Synapse is an all-in-one data & analytics platform that combines data ingestion, big data, data warehousing and ETL processes in the cloud. With it, you can fetch your data from ADLS, clean it, treat it and store it in your databases or lakes which allow all your separate processes. This is because Synapse integrates a lot of applications from Microsoft like Azure Data Lake, Azure Data Factory, etc. making it a really powerful tool when it comes to working models. Why? Because Synapse makes your work much more comfortable since you don’t need to work separately on your database application (SQL Server), ETL tool (SSIS) and visualization tool (Power BI). Even for versioning and DevOps of your projects, Synapse can stack really well because it is fully integrated with Azure DevOps allowing you to seamlessly manage all artefacts. Besides this, you can have a place where you can monitor everything that happens with your data from the beginning to the end. On top of this, you can evolve your process to use machine learning algorithms because Azure Machine Learning can be integrated too.

Without a doubt, there are many benefits of a tool like Synapse, and the empowerment it can bring to companies that want to raise the bar on their data journey is immeasurable.

3. Visualization with Power BI

Being able to analyze data is crucial, and nowadays, you have tools to build fine charts and tables with everything you need to know. But what is Power BI? It’s the place where you can build reports or dashboards with all the data that has been talked about in the previous points, so you can make your decisions based on facts and not only guesses. In an Azure solution, you still have to create content on Power BI Desktop, but everything else will be made on the cloud so, all the maintenance and editing can be done in the Power BI service workspace, which you can easily integrate into the Synapse studio.

Basically, by having that integration, in one place, you can fetch and store data, and process and present it through interactive and dynamic dashboards.

4. Cataloging data with Purview

Purview is a data governance tool that helps companies govern and manage data. You can use Purview to catalogue all data from your data sources and manage sensitive information or tag it allowing you to streamline the process and make it automatic.

Another feature you gain is to see the lineage of your data and know where it comes from and where it goes so you can track how your processes are going. These are valuable advantages you can obtain by using Purview but there is more – by having everything catalogued, all users in your company can access that catalogue to explore and find insights or check for sensitive data.

Guess what? Purview can be integrated with Synapse and from there call all the features to work with everything in the same place.

Final Thoughts

Things are changing, the cloud is becoming the new king, and although the market is really vast, betting on cloud analytics with Azure Synapse came to change the game. With it, companies can be more agile by centralizing analytics work in one place. For those who need to open their database manager, their ETL tool and their visualization tool, Azure Synapse understands that having all three in one place leverages their work tremendously because having everything together leads to a better-managed project with fewer errors, version problems, compatibility issues, and many other situations that are mitigated with Synapse. All that, plus having the capability to catalogue and lineage data, makes this tool even more complete, ensuring proper governance.

The improvement of competitiveness for companies using Synapse is a game-changer. You may have a BI cloud solution with different types of tools and all of them scale very well but you can clearly see the benefits of having a tool that can potentiate the management of all BI processes in the same place with everything integrated. This makes the whole process easier and agile which, in the end, brings more value from data that’s easily handled with new business drivers.

José MirandaCloud Analytics solutions with Synapse
read more

Lumada Data Catalog: the solution for data organisation

5-SECOND SUMMARY:
  • What is Lumada Data Catalog and how to take advantage of this new tool;
  • How to catalogue, organise, control sensitive data and manage redundant data, and also, how to manage all the owners and stewards in your data catalogues.

What would you do if you knew that the way you organise data could be greatly improved? The information gathered from the existing inputs to your company gets bigger every day, and in a way, you need to treat that with big data tools and processes. However, as time passes and the data you store gets wider, the risks of having everything unorganised and losing track of what’s happening increase. This may lead you to spend human hours trying to discover what you want to analyse or being out of bounds in terms of sensitive data compliance. In truth, how can you be data-driven if, in fact, you can’t find data?

Information is everywhere, which we then turn into efficient accessible knowledge by organising and categorising by subject. This happens with books, presentations, code, any other type of information, and now, with data. By cataloguing the information you retrieve from your company’s inputs, you can label and easily find the data you want to work on to prevent the risks we spoke about before. One of the tools that give you the power to achieve that is the Lumada Data Catalog. This Hitachi tool lets you catalogue your data using artificial intelligence and machine learning algorithms that give labels to your data and validate those tags with statistical evaluations, which you can then confirm if they’re right or wrong and teach the algorithm how to perform with your data. But what can you really do with this tool and what value can you retrieve from it? Let’s look at the facts:

1. Organize & Discover Data Quickly

Having all your data catalogued is like having an index for it. You can access and discover specific blocks of information by using the tags functionality. How does this happen? The Lumada Data Catalog uses an AI process that populates your data catalogue automatically, reducing the need to manually discover and tag data because, for huge amounts of information, manual discovery is not manageable anymore. After that, you can accept those tags or add new ones, such as the ones you like to use or your business terms, to classify your data and make the AI process do the rest for you. This gives you the ability to have all your data inventoried and you’ll just need to search for the specific tags you want.

2. Control Sensitive Data

While identifying and tagging data, the Data Catalog AI process will automatically get all of the sensitive data it can find and give it the proper label. If there were other data fields you would like to label as sensitive, you would just need to give the same tag to them. This gives instant knowledge and the ability to maintain your company’s compliance with data privacy regulations.

3. Manage Redundant Data

Maybe you don’t notice, but it’s really easy to have redundant data. Normally the way you know that is when you have the same field coming from different places and you don’t know which one to use. Having your data organised and catalogued you can recognise when you have redundant data and where it comes from, which helps you quickly manage this kind of inconvenience.

4. Owners and Stewards

When you have a data catalogue it’s like having a library and as such, you must have someone guarding everything. That’s why you have owners and data stewards. These roles maintain and manage your data catalogue and help your end users every time they have a doubt or need to find something. By having these people you’re giving a contact point to everyone in your company regarding any matter about data.

Final Thoughts

It’s clear that having a data catalogue can really improve the way you treat and share data across your company. Besides that, treating your sensitive data properly and having specialised people managing your data, with whom your end users can talk, and following procedures is the right way of working as a data-driven company. The Lumada Data Catalog can improve this process even further by using AI and machine learning technologies that let you organize everything automatically. This can bring faster insights and decision making to your company and leverage your capability of being competitive in today’s markets.

José MirandaLumada Data Catalog: the solution for data organisation
read more

3 successful embedded analytics trends to follow

Now, more than ever, the world understands the value of data and the infinite possibilities it gives to those who make decisions. If your company provides any kind of service, with great probability you collect data; and if you don’t have any strategy for managing it, then you’re missing out. The opportunities you can find in the data that your business’s daily activities generate can be huge and when you see the power beneath it, you’ll want to use it. We’re talking about giving your customers even better value based on their own data. We’re telling that you can monetise even more of what your services are producing. We want to stay simple, so today we’re going to talk about these 3 possibilities, 3 successful embedded analytics trends, and how you can achieve them with Tableau. Let’s see:

1. Improve your services with embedded analytics

Being free to implement your analysis wherever you want, is really a great help to achieve what your clients envision. You can embed Tableau Server or Tableau Online in solutions that you can then provide to your clients. This means you can build all the reports you want in Tableau and then integrate them into every product, service, web portal or app that you want. The power you earn to personalise your offering is massive and will make your clients feel they can have their own analytics instead of a standardised one. Beyond that, this functionality can improve your actual services or give them an extra layer, a so-called “extended product” where you can augment your service package according to the needs and wants of your clients or what you think may be better for them. So, it’s clear that this can give you great agility building personalised solutions for your clients and beyond this, you can do it while enjoying the best of Tableau’s capabilities.

2. Monetisation

Everyone praises data now. The market understands its inherent value and the companies who treat and monetise their data are the ones leveraging it for their businesses. Although it helps with making better-informed decisions, based on facts instead of predictions, data can become a service or a product in itself and there are a lot of options and approaches for that. After having embedded your solution, if your company works with client data and you want to give them insights using dashboards, especially the ones you build in Tableau, you can create products or services around them in order to monetise the insights and the value you can retrieve from those analyses. Moreover, you can give each client a personalised or standardised solution, with the personalised solution being more expensive.

3. Build vs. Buy

Of course, you could build your own solution, but buying is often the better option. Why? Well, if you choose to build, you’ll start from scratch and your solution will probably be based on a complex process that needs lots of maintenance and people’s attention to be focused on doing analyses and preparing reports. This means it will take a significant amount of time before you start adding value and besides this, the feature set available will always be limited by your development capacity.

Tableau has been on the market since 2003, so it’s clear that it has had tons of time spent on developing and perfecting its ability to build cool reports. If you choose to buy, you know that is the only cost you’ll support to access years of knowledge. Besides this, it will take much less effort, and setup will be faster, as you won’t need people to develop and maintain the solution because you’ll be able to direct people to focus on analyses and reports. Implementation will be way easier and you’ll be building reports that can be easily changed over time in Tableau.

Final Thoughts

Embedding analytics is a powerful capability that Tableau offers. Using reports that can be easily built-in Tableau on your apps, products or services can open a new world of opportunities where everyone wins and value is created. This is part of what digital transformation is about and we are here to help you on that journey. Take a look at our Tableau solutions and get in touch with us; we’re here to help you establish a strategy to implement the most successful embedded analytics trends, so you can use your data analytics in the right places, with the right people, in the right way.

José Miranda3 successful embedded analytics trends to follow
read more

Business Intelligence, the ally of decision makers

When we talk about decision making, we mean a course of action where selections are made from a range of possible scenarios to achieve a goal or solution. Every company is the path it takes, and while there’s no way to predict the future accurately, choosing wisely can have a huge impact. The truth is, behind every company decision there are people under pressure to make good choices using the information they have available at that moment. This means that to develop the best strategies, companies need trustworthy external and internal information to understand what they are dealing with and where they need to make changes. Imagine you are choosing between paper and digital? Rebranding your product or changing its positioning? Increasing your margin percentage or focusing on bringing costs down? Diversifying your offer or creating an extended product? Companies are built on decisions – and so is yours – and how can you make good decisions without good information? How can we ensure that decision-makers, such as C-Level executives, department managers, or even shift managers – people whose decisions have real impact – consistently make good decisions? And the answer is “Business Intelligence”. We’ll explain:

Transparent Data

Through its automated tools and systems, Business Intelligence (BI) can help decision makers by mitigating human error and the generation of inaccurate information. When you have transparent, concise data, your decisions are supported by solid premises. Many BI tools give you the capability to certify data, which enhances the credibility of your decisions.

Forecast trends

Gathering data that monitors company processes is useful for building forecasts that utilise analytics. These can help you decide on resources, strategies or investments by giving you market data such as expected demand or consumer behaviour.

Historical performance on time

With a well implemented BI solution, your company can get real-time insights on historical performance. In this competitive world, deciding fast and well is a distinct competitive advantage. Mitigating losses or making successful comebacks from adversity is something BI can help you potentiate with instant, precise information which you can rely on to implement accurate solutions.

Now we know some characteristics of the impact of BI, let’s talk about four examples where it can help you achieve your company’s goals:

1. Sales & Marketing

Using BI, organisations can explore sales trends or customer buying trends by analysing behaviours, choices and preferences. Comparing these trends against your customer personas, you’ll be able to rearrange your sales strategies, repositioning a product, rebranding, tailoring promotions or campaigns and maximising your engagement strategies to maintain good key performance indicators (KPIs) and leverage bad ones.

2. Inventory

The benefits of BI in supply chain management are well known. The supervision achieved by a BI solution can aid you avoid excess stock and exorbitant costs incurred from storing items unnecessarily. Management of items that have been in stock for a long time and get overlooked is another strength you can capitalise on. Furthermore, by analysing a product’s ordering pattern, you have the ability to build new strategies for that product and alter prices to achieve a better profit margin.

3. Finance

Finance is one of the most important subjects for an organisation. BI gives you the ability to analyse financial reports better. You are able to see current outgoing and incoming figures and compare them against past performances or benchmarks in order to develop financial strategies based on a precise financial status where KPIs can be easily accessed.

4. Executives

When a BI solution and a strong data-driven culture are properly implemented, executives can rely on the information that BI gives them. All the KPIs, forecasts, financial reports and statistical facts generated in visualisations and dashboards can support decisions about the future of your company to achieve growth and success or mitigate the impact of unexpected crises. Furthermore, this kind of information enables you to make well-informed decisions and act to improve overall performance.

Pensamentos finais

Decisions are made every day. Bad ones, good ones – but all of them build a company. We are what we choose to be and the companies we own are just as those running them choose them to be on a larger scale, supported by the spectre of individual choices. We know how important BI is to company decision-making, and the benefits a data-driven culture brings. Our Data Innovation Journey explains the steps you’ll need to take to achieve this, making everything clear and providing help along the way that you can always count on to aid your company to achieve its best. We strongly believe in the potential of BI to be the right ally to aid you with decision-making, because after all, it’s all about the data.

José MirandaBusiness Intelligence, the ally of decision makers
read more

And the winner is… modern BI!

Why ‘modern Business Intelligence‘ is so important for your organisation in order to become more competitive?

Modern BI gives you the flexibility to build a data-driven culture where you can make decisions based on facts rather than guesses or assumptions. Instead of relying solely on EDWs (enterprise data warehouses), like traditional BI, it comes with a set of new visual interactive tools to tackle all kinds of tasks from IT to workflow. BI is no longer just a project; the goal is now a data-driven company in which BI connects data with its end users through ETL (extract, transform and load) and visualisation tools. What we want here is to demonstrate how modern BI can bring value to your company and we’ll do that via the following trilogy.

1. Accessing data

Connecting to data has become so much easier. Nowadays you can connect to every type of DB (database), to a set of files, like PDF or excel, and to APIs or data from the web with web data connectors, etc. You can do this from a BI tool such as Tableau Desktop or Power BI, which let you connect directly to these data sources. Think about it; many companies rely on Excel as an output for their departmental information. Imagine that you prepare monthly report files on sales figures. How best can you compare your sales performance for 2008 against that of 2018? Are you going to open all those Excel files? How can you build a sales vs region map by year? And drill down to data for every month? Well, fortunately, modern BI tools can give you all this. You get the capability to quickly connect your Excel file, or a load of Excel files (by joins or relationships) to Tableau or Power BI, which means you’re acquiring a real upgrade of analysis efficiency because in a matter of minutes you can clean, normalise and use all the data to build dynamic reports and dashboards.

Bear in mind that sometimes data isn’t completely error-free, so a cleaning process must be carried out, which you can do easily in the tools mentioned above with just a few clicks. However, if you have many complex files, which need to perform complicated calculations, or you want to join too many different data sources, you’ll need an ETL tool like Pentaho, Tableau Prep or SSIS (SQL Server Integration Services) and a database into which your ETL can drop the data from all those sources.

2. Building visualisations

All right, connecting data has new fancy options and is now much faster, but the coolest thing is building the visualisations. Forget those old static charts and tables or maps. Nowadays, BI solutions give you the ability to construct every type of graph to display information exactly as you want. Using a single graph, in few minutes, you can create a visualisation by year with the possibility of drilling down to individual days; or you can drill down by hierarchies, for example, showing profit first by product group and even further until you reach profit by individual product. You have the ability to incorporate filters into your visualisations in order to be more precise with your analysis. You can build parameters to enable you to see different KPI’s (key performance indicators) by groups of products meaning that in the same visualisation, you can explore profit or number of sales or margin by product. Nevertheless, you can explore raw data by creating tables with all the information you need.

Alongside these cool attributes, there’s another important functionality. You can explore and analyse all the underlying data. Choosing a group or clicking on a specific point on your graph, you can promptly see the information behind the values. With this, you’re never working blind, and guess what, you can export these pieces of data to file. Using this functionality with the visualisations, you can do your own exploration and analysis in which you’ll be able to find trends or outliers and take interesting conclusions.

You arrive at a place where you’re able to create views that you can group in a super-dynamic dashboard full of filters and parameters that can be applied to all your graphs, tables and maps. With dashboards, you can create data stories where you tell a story using snapshots of a specific dashboard to communicate data much easier and more consistently.

It gets even better because after constructing visualisations you can then share them with everyone in your company and decide who sees what.

3. Governance

If the visualisations are cool, imagine how awesome it is to easily share content with anyone in your company. Tools like Tableau or Power BI give you the opportunity to bring all your content together in one place, divided by project or department. We’re talking about your data sources and dashboards in which you can create groups of users and decide their permissions. Imagine that you build a marketing dashboard and publish it via the online service. You have users in all your company’s different departments but you only want those in marketing to be able to see this dashboard. To achieve this you create a group called Marketing, add all your marketing users to it and grant them permission to see your content, while for other groups, such as Finance, for example, you deny permission.

The online service is managed either through a physical server or based in the cloud, with a high level of security. To connect, you can use login directories such as Active Directory, or you can create one locally. You can embed your interactive visualisations into webpages, which will refresh any time that you change the underlying data. Defining schedules and alerts is something you’ll find really useful. Schedules for refreshing data, for example, and alerts for when a KPI reaches a specific limit. Despite this, you are able to monitor everything: who has accessed what, performance, space usage, tasks, etc.

The best part of all of this is the fact that your IT personnel are still an important part of managing access to data, but with the right software, every user is empowered to view, customise, create and edit dashboards and reports or analyse data in far less time.

Final thoughts

As we said, BI is no longer simply a project. BI is a living being in your company. Imagine your company as a city and BI as a data speed highway flowing freely between every corner of that city. Scalability becomes very effective as you can upgrade your departments to the digital culture in less than no time or upgrade your old digital BI structures, which will then become even faster.

The given value of monitoring, making decisions, analysing information quickly or sharing insights between people and departments is one of many other strengths that BI can offer you, although business users become more autonomous to do so.

For sure, modern BI is a winner that caught the speed of our fast, competitive, changing world and earned its place right next to business fabric, and this is how XpandIT DIaaS (Data Innovation as a Service) became real. By defining your strategy, deploying, maintaining and supporting a robust data solution, and helping you build your speed highway, we can help you define the process of positioning yourself as a competitive data-driven company and of course, a winner because when you win, we win too!

José MirandaAnd the winner is… modern BI!
read more

Green Deal: 5 reasons to become a data-driven company

Let’s face the truth, sooner or later every industry will have to comply with ecological directives, whether they come from the European Commission or another organisation with a similar kind of influence.

In fact, as many of you know, in December 2019, the Commission published a white paper called “The European Green Deal”. This deal had the purpose of changing the way European Union (EU) and all of its citizens cherish our climate and environment.

It isn’t hard to understand that European companies will have to be the earliest pioneers and data-driven companies will most easily adopt such directives. Therefore, if you want to stay competitive and quickly absorb the coming changes regarding production or daily operational processes, you should give a data-driven business model a try.

Why? Because you’ll be able to analyse and take actions knowing exactly what’s happening with your day-by-day operations instead of just making assumptions. You’ll have data organised in digital infrastructures allied to Business Intelligence, Data Science and Big Data solutions.

For you to understand this better, we’ll analyse 5 points, but this comes with the warning that the deal contains an incredible wealth of information and here we can only focus on those parts that matter for the purposes of this article. However, we advise strategic managers to read the Green Deal.

1 – Clean, efficient energy

According to the Deal, 75% of the greenhouse gas emissions in the EU emanate from the production and consumption of energy by economic sectors; so in order to reduce those numbers, power sources must become built around renewables and must work towards being 100 percent digitised and structurally interconnected throughout.

As a data-driven company you’ll know precisely what is being consumed and exactly how much. For example, you will be able to understand if you’re using renewable resources or not, how much electricity is spent, how much water is being used or how much heating and air conditioning is wasted. Better strategies can be built by evaluating the consumption required by day-to-day operations and evaluating whether they are running efficiently and what resources they required.

2 – Clean, circular economy

Only 12% of the materials used by EU industry are recycled and, the extraction of new materials tripled between 1970 and 2017, is still rising and represents a global risk. Because of this, in order to achieve Green Deal objectives, the Commission want companies to embrace ecological and digital transformation and be more independent of the requirement for new materials, which are converted into products and then disposed of as waste or emissions. In fact, the Deal reveals that the Commission’s priority is to reduce the use of new materials and improve their reutilisation, reserving recycling as a third plan.

As a data-driven company, you’ll be capable of monitoring production lines and retrieving data in order to analyse the amount of resources used to produce any item or measure (in tonnes, for example), which materials are being used and how much waste is being generated. With this information, you’ll be able to redirect production lines to ecological purposes, using materials more efficiently and producing less waste or optimising recycling. Besides this, having a digital view, you can become a role model in your industry by developing efficient models and innovating ways of producing products in a disruptive way.

3 – Construction and buildings renovation

The rate of annual building renovations in the EU is between 0.4 and 12%. The Commission states that this rate must double in order to achieve climate objectives. On the other hand, millions of consumers fight to keep their homes warm. To solve this problem, the Commission will encourage the renovation of private and public buildings, tighten energy efficiency legislation around building and follow the circular economy logic by increasing the digitalisation of housing stocks. The Commission will also review Construction Products Regulations.

As a data-driven company, you’ll have the data analysis tools to give you insights into what materials are used in every project and where to use better materials if needed, so that buildings have lower energy consumption. Getting an intimate view of how construction is carried out and having data on the effectiveness of every material used, you will easily comply with coming changes on energy efficiency legislation.

You’ll know how to organise stocks efficiently in order to reduce waste.

As a company linked to construction, you will be able to design solutions to retrieve data about consumptions and energy efficiency to houses or buildings owners. You will also be able to build intelligent houses that climate efficiently using smart windows and temperature balance systems with air purity and circulation or houses with vertical garden for air renovation, humidity prevention and acoustic renovation. This applies to both new construction and buildings renovation.

4 – Sustainable mobility

According to the Deal, to achieve climate objectives, transport emissions should be decreased by 90%; and by transport, they mean all types (cars, planes and boats, etc.). To address this, the Commission will create a strategy for this challenge that strikes at all these sources of emissions.

As a data-driven company you will be able to control your fleet with devices that provide information on consumption and emissions for every vehicle. With this data, you can rethink strategies and change your fleet if necessary (from diesel to electric power, for example) or redesign routes to reduce mileage and emissions.

If you are a transport industry manufacturer you will be able to get consumption, emissions and efficiency data from your engines and others parts of your products, which will tell you precisely where something isn´t so effective. You’ll be able to understand the performance of your products and what to do to reduce emissions, even if it means less power.

The same applies to battery manufacturers. You’ll be able to retrieve data on the relative performance of your batteries and the exact materials that go into producing them. This will give you in turn ideas on how to extend your battery lifetimes or develop efficient production lines producing lower emissions, which could encourage your customers to switch from fossil fuels to electric fleets.

5 – Healthy, environmental-friendly food systems

Producing food pollutes the air, water and soil, affects climate change, contributes to the degradation of biodiversity and consumes too many natural resources when that food is wasted. Nowadays there are new technologies, discoveries and public awareness that can present new opportunities to producers and value to stakeholders. To change the way in which food production pollutes our planet, the Commission has developed a “Farm to Fork” strategy. Furthermore, their proposal defines that at least 40% of the Common Agricultural Policy’s overall budget and at least 30% of the Maritime Fisheries Fund would contribute to climate action”.

As a data-driven company you will know exactly how much water is used on your farms, how much water and grass your livestock require and amount of chemical pesticides, fertilisers and antibiotics used, as well as many other important facts. This allows you to devise new ways of operating using lower consumption of resources and less chemicals in food.

The future has to be different, so it is just a matter of time before your company is forced to change its strategies and find new ways of producing clean, sustainable products. The data you get from your farms, vineyards, greenhouses, aquaculture, etc., married to data on your customers’ needs and choices, will become essential to helping you achieve the Green Deal objectives.

Final thoughts

We’re speaking about a massive transformation over the next 30 years, and we believe that companies averse to change will live hard times. Environmentally friendly, sustainable companies will be ever more valuable in the coming years. We cannot forget that new generations are growing increasingly aware of environmental and inequality problems. They are the ones who will force their employers and their parents to change their behaviours. They are our up-and-coming consumers and the ones to listen to.

Europe knows the future exposes new environment-friendly paradigms and wants to become the pioneer of these patterns, not only for future competitive and economical purposes but because it is mandatory.

A good way to discover where to go next is to know where you came from, which means that one way to understand where your company needs to go in the future is to analyse your daily data and understand exactly what you’re doing at present. You’ll need to be strategically well informed and capable of joining valuable information to help build future strategies and policies.

A great way to become a successful data-driven company is to get the help from a data specialist partner who understands Business Intelligence, Data Science and Big Data services, like we do at Xpand IT, and who can provide you with a DIaaS (Data Innovation as a Service) solution to guide you on your journey to becoming a data-driven organisation.

Your solution evolves over time and goes from those first steps of building and setting out your strategy, on to the implementation phase with its analytics and data science components and finally to maintenance, training and support services. You will end up with quite a set of automated processes, that will enable you to take more from data and in the end be so much more efficient; This is in fact a noble cause, as in the end, you will also be fighting climate change – and we are here to stand by your side.

José MirandaGreen Deal: 5 reasons to become a data-driven company
read more