@Srinivas, apologize for the late response,

1. I have not logged medium! Actually, I don't have experience with Logi Analytics. If we compare Quicksight vs the tools I used in the article - (1) customization, (2) refresh frequency, (3) interactivity, (4) secruity, (5) scalability.

(1) you can add custom colors, there are standard graph types + maps + sankey + world cloud - https://docs.aws.amazon.com/quicksight/latest/user/working-with-visual-types.html;

(2) Quicksight enterprise allows setting an hourly refresh schedule not live connection - https://docs.aws.amazon.com/quicksight/latest/user/refreshing-imported-data.html;

(3) you can add drill-down to graphs - https://docs.aws.amazon.com/quicksight/latest/user/adding-drill-downs.html;

(4) you can cann row-level security - https://docs.aws.amazon.com/quicksight/latest/user/restrict-access-to-a-data-set-using-row-level-security.html;

(5) with enterprise edition you…


Background

The article is written as a part of the Data Engineering coaching from Team Data Science. The objective is to share the newcomer perspective on IoT and data lifecycle in the IoT industry directed towards newcomers. Feel free to correct in case if some/all parts have little/no sense.

You can find the first article ‘So, you want to be a smart farmer’ where I laid the foundation of the project here.

A network of things

The Internet of Things (IoT) is a network of physical devices that are able to connect to a network and exchange data. The devices, which form the IoT, are…


Why smart farming?

Source: WorldBank

The agriculture sector plays an important role in generating employment and contribution to the gross domestic product (GDP) globally and on regional- and country- levels. 27% or approx. 1 in every four people in the world work in agriculture, as per WorldBank. Or we look at the regional data, almost one in every two people (53%) in Sub-Saharan Africa works in the agriculture industry. Agriculture, forestry, and fishing contributes 3.4 percent of World GDP in 2018, while in Sub-Saharan Africa, the contribution reached 16% of GDP.

Farmers in the developed world are increasingly using sensors to figure out what, when…


Whenever I read use cases about large enterprises, having 900+ applications running, I always got the chills thinking about data transfer between the systems. And it usually followed by the thought, ‘how does the business know if and what data exist or because the company reached such a scale, each unit becomes self-sustained in terms of its data needs?’ And people figured it out — well, apparently kind of. And the answer is ‘data catalogs’. As per Dataversity, ‘A data catalog informs customers about that available data sets and metadata around a topic and assists users in locating it quickly’…


Screenshot from ubuntu

I was always puzzled with tutorials and courses on ‘How to install X’ as they do talk about ‘how to install X’ but in many cases, it is all about running X locally and manually, and the authors hardly mention getting X into production. …


Source: John Collier / Public domain

In Ancient Greece, it was believed that decisions of any significance were guided by the divine, thus, it was presumed that Gods spoke through Oracles — from the Latin verb ‘orare’ (to speak). Oracles were consulted concerning the yield from crops, health issues, financial fortunes, among others. The modern Oracle moved away from Greece, changed garment, and narrowed one’s focus to forecasting the company’s revenue, customer churn, and company’s sales. …


“Look, sir. Don’t worry about me,” I said. “I mean it. I’ll be alright. I’m just going through a phase right now. Everybody goes through phases and all, don’t they?” Indeed, Holden, everybody goes through stages of growth, including organizations. CMMI, ITSM/ITIL, Agile, DevOps, Project management, Capabilities, Knowledge management, Processes, Risks, Cybersecurity, Cloud, Enterprise architecture, Testing, People capabilities, and the list of functions goes on.

The goal of this article is to briefly describe maturity models concepts, give an overview of the Data Management Maturity Model (DMM) and list other data-related maturity models. …


‘Embedded analytics is a digital workplace capability where data analysis occurs within a user’s natural workflow, without the need to toggle to another application.’ [1] More than 85 percent of 500+ respondents of Logi Analytics’ annual State of Embedded Analytics [2], primarily from North America offers embedded analytics in some form to their SaaS applications. Sounds good, doesn’t seem to work. …


I have two questions I wanted to ask you.

Are the apps developed by your company deployed as software as a service (SaaS)? According to the Cisco Global Cloud Index (GCI) study, SaaS has been maintaining the majority share among global cloud services and will reach 75 percent of the total cloud workload by 2021 [1], so it is safe to say that a probability that your company deploys the applications as SaaS is very high.

And my second question is how do you access data captured in your application? In its ‘The Complete Guide to Embedded Analytics’ [2], Log…


It still puzzles me that “В то время, как наши космические корабли бороздят просторы вселенной…”, we are still using the data management tools developed back in 90s. And as you can imagine, companies of those days rarely give away something in the form of an open-source or freemium product. A case in point? Data profiling tools. Don’t get me wrong, there are plenty of articles on the Internet on how good data profiling is — a simple search on “data profiling” returns 490K results; “data profiling tools”, 14K+ results. Things get more interesting if you search for “data profiling open…

Eka Ponkratova

I’m a data consultant, specializing in ETL, reporting, BI, dashboarding and analytics www.linkedin.com/in/eponkratova

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store