{"id":30696,"date":"2021-11-16T17:41:22","date_gmt":"2021-11-16T17:41:22","guid":{"rendered":"https:\/\/naiveskill.com\/?p=30696"},"modified":"2023-02-04T08:43:01","modified_gmt":"2023-02-04T08:43:01","slug":"install-atlas","status":"publish","type":"post","link":"https:\/\/naiveskill.com\/install-atlas\/","title":{"rendered":"Install atlas | Complete tutorial with examples in 2023"},"content":{"rendered":"\n<p>As data size grows, the complexity of managing compliance and governance grows in the same proportion. This blog will understand how to install atlas in your system.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What is apache atlas?<\/h2>\n\n\n\n<p>Before installing an apache atlas, let&#8217;s first understand what apache atlas is and why every organization must have a data governance and compliance tool.<\/p>\n\n\n\n<p><a href=\"https:\/\/atlas.apache.org\/#\/\" data-type=\"URL\" data-id=\"https:\/\/atlas.apache.org\/#\/\" target=\"_blank\" rel=\"noopener\">Apache Atlas<\/a> is an open-source tool used for data governance and metadata management. Apache Atlas allows companies to effectively and efficiently meet their compliance requirements.<\/p>\n\n\n\n<p>Apache atlas&#8217;s popularity is growing because it easily integrates with well-known big data tools like Hadoop, Kafka, spark, hive, impala, etc. It also provides REST API which we can use to update and create the data lineage.<\/p>\n\n\n\n<p>I have many pre-defined types, and users can add new types based on their requirements. It also supports a SQL-like query engine to search entities. You can check <a href=\"https:\/\/atlas.apache.org\/#\/\" data-type=\"URL\" data-id=\"https:\/\/atlas.apache.org\/#\/\" target=\"_blank\" rel=\"noopener\">this<\/a> link to understand more about the atlas features.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How to install atlas<\/h2>\n\n\n\n<p>In this session, we will learn how to install apache atlas using <a href=\"https:\/\/www.docker.com\/\" data-type=\"URL\" data-id=\"https:\/\/www.docker.com\/\" target=\"_blank\" rel=\"noopener\">docker<\/a>. You can follow <a href=\"https:\/\/naiveskill.com\/hello-world-docker\/\" data-type=\"URL\" data-id=\"https:\/\/naiveskill.com\/hello-world-docker\/\">this tutorial<\/a> to install docker on your system.<\/p>\n\n\n\n<p>Now type the below command to pull the atlas docker image<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"dockerfile\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">docker pull sburn\/apache-atlas\nUsing default tag: latest\nlatest: Pulling from sburn\/apache-atlas\nd519e2592276: Pull complete \nd22d2dfcfa9c: Pull complete \nb3afe92c540b: Pull complete \n9070b09379d6: Pull complete \n968e3feb8e26: Pull complete \n4568df43ab62: Pull complete \n6cd5206cb36f: Pull complete \n7e90f6010249: Pull complete \n9646c7ee49f9: Pull complete \n57a26972c6b6: Pull complete \n4ddabc3ff1ef: Pull complete \nDigest: sha256:1eca23ef34204ee9a15ec809b695fb0a1a2a12cf68db18642c9e90875675a5c6\nStatus: Downloaded newer image for sburn\/apache-atlas:latest\ndocker.io\/sburn\/apache-atlas:latest<\/pre>\n\n\n\n<p>Now type the below command to verify if the images get pulled successfully<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>docker images<\/code><\/pre>\n\n\n\n<p> Now run the docker image by typing the below command<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"dockerfile\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">docker run -d \\\n-p 21000:21000 \\\n--name atlas \\\nsburn\/apache-atlas \\\n\/opt\/apache-atlas-2.1.0\/bin\/atlas_start.py<\/pre>\n\n\n\n<p>Verify if the docker container is running<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"dockerfile\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">docker ps\nCONTAINER ID   IMAGE                COMMAND                  CREATED         STATUS         PORTS                                           NAMES\n7092a4f8e34b   sburn\/apache-atlas   \"\/opt\/apache-atlas-2\u2026\"   3 seconds ago   Up 2 seconds   0.0.0.0:21000->21000\/tcp, :::21000->21000\/tcp   atlas<\/pre>\n\n\n\n<p>Go to http:\/\/localhost:21000&nbsp;to access atlas UI <\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_ui-1024x925.png\" alt=\"atlas login\" class=\"wp-image-31495\" width=\"807\" height=\"728\" srcset=\"https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_ui-1024x925.png 1024w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_ui-300x271.png 300w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_ui-768x694.png 768w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_ui.png 1180w\" sizes=\"(max-width: 807px) 100vw, 807px\" \/><\/figure>\n\n\n\n<p>use admin\/admin creds to log in to the Atlas UI.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"693\" src=\"https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_home-1024x693.png\" alt=\"atlas home\" class=\"wp-image-31496\" srcset=\"https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_home-1024x693.png 1024w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_home-300x203.png 300w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_home-768x520.png 768w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_home-1536x1040.png 1536w, https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/12\/atlas_home.png 2044w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>On successful login, users will see this page. You can use different search options to filter out the required data. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Add sample data to apache atlas<\/h2>\n\n\n\n<p>When you log in to Apache Atlas UI, you won&#8217;t get any preloaded data in the atlas. But atlas provides a way to load data into the apache atlas.<\/p>\n\n\n\n<p>Now to load the data into the docker container, go inside the docker container by typing the below command<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>docker exec -it 7092a4f8e34b \/bin\/bash<\/code><\/pre>\n\n\n\n<p>Finally, type the command to load data to apache atlas<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>python \/opt\/apache-atlas-2.1.0\/bin\/quick_start.py<\/code><\/pre>\n\n\n\n<p>use admin\/admin as username and password<\/p>\n\n\n\n<p>Once you run the above script, the following data will get inserted into the apache atlas.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"dockerfile\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">python \/opt\/apache-atlas-2.1.0\/bin\/quick_start.py\nEnter username for atlas :- admin\nEnter password for atlas :- \nCreating sample types: \nCreated type [DB]\nCreated type [Table]\nCreated type [StorageDesc]\nCreated type [Column]\nCreated type [LoadProcess]\nCreated type [LoadProcessExecution]\nCreated type [View]\nCreated type [JdbcAccess]\nCreated type [ETL]\nCreated type [Metric]\nCreated type [PII]\nCreated type [Fact]\nCreated type [Dimension]\nCreated type [Log Data]\nCreated type [Table_DB]\nCreated type [View_DB]\nCreated type [View_Tables]\nCreated type [Table_Columns]\nCreated type [Table_StorageDesc]\nCreating sample entities: \nCreated entity of type [DB], guid: c20def06-fb2a-452c-8ef9-bbd57708dede\nCreated entity of type [DB], guid: e3be9ce6-5eac-4e0b-9f25-01294fd72f34\nCreated entity of type [DB], guid: ae2d7638-9319-4ea6-b46c-e29ccf2a2079\nCreated entity of type [Table], guid: 4d8f5fad-0e91-4b7b-876d-7373ce8286c9\nCreated entity of type [Table], guid: fd4648ce-7e06-4ce2-b12b-24d1c0f38f41\nCreated entity of type [Table], guid: 85e75fdf-9ef7-4a88-bd97-6c9b1183de31\nCreated entity of type [Table], guid: ff1a2797-af24-4712-98bc-a7524a67d652\nCreated entity of type [Table], guid: f4de886d-00be-4664-aa3c-fa6e1f0cc44f\nCreated entity of type [Table], guid: fd5ec4df-a5d8-401b-91a8-1cc1435de000\nCreated entity of type [Table], guid: 2956330a-03c0-483e-accb-423edc39d4b7\nCreated entity of type [Table], guid: cfce1b26-73c5-4e16-819d-cc4d5cebb317\nCreated entity of type [View], guid: 7220d223-17ac-4042-9dea-9d087314c976\nCreated entity of type [View], guid: 274afdbe-3a40-4e25-b53c-7f8bc0efa9fa\nCreated entity of type [LoadProcess], guid: 9f0135c1-8c1e-4f29-a95a-50e539066d8d\nCreated entity of type [LoadProcessExecution], guid: 821a79af-9942-46ac-94fb-a5c4814f1cde\nCreated entity of type [LoadProcessExecution], guid: cfd36c58-e1e5-48df-839f-65a50a25d15a\nCreated entity of type [LoadProcess], guid: d68ed431-47c6-4163-8a47-6e220cee7aaa\nCreated entity of type [LoadProcessExecution], guid: c632fc7d-c24d-466e-997e-2be170bfd533\nCreated entity of type [LoadProcessExecution], guid: 9d852052-5314-4b3e-81a7-084c24949e2b\nCreated entity of type [LoadProcess], guid: 55d3b414-67b2-4384-bc5d-11ac1e2c3b49\nCreated entity of type [LoadProcessExecution], guid: b1793392-5292-4596-9fac-aeb44fe871eb\nCreated entity of type [LoadProcessExecution], guid: fafbe5d8-b179-425a-b85a-c6a37c0dd7ed\nSample DSL Queries: \nquery [from DB] returned [3] rows.\nquery [DB] returned [3] rows.\nquery [DB where name=%22Reporting%22] returned [1] rows.\nquery [DB where name=%22encode_db_name%22] returned [ 0 ] rows.\nquery [Table where name=%2522sales_fact%2522] returned [1] rows.\nquery [DB where name=\"Reporting\"] returned [1] rows.\nquery [DB where DB.name=\"Reporting\"] returned [1] rows.\nquery [DB name = \"Reporting\"] returned [1] rows.\nquery [DB DB.name = \"Reporting\"] returned [1] rows.\nquery [DB where name=\"Reporting\" select name, owner] returned [1] rows.\nquery [DB where DB.name=\"Reporting\" select name, owner] returned [1] rows.\nquery [DB has name] returned [3] rows.\nquery [DB where DB has name] returned [3] rows.\nquery [DB is JdbcAccess] returned [ 0 ] rows.\nquery [from Table] returned [8] rows.\nquery [Table] returned [8] rows.\nquery [Table is Dimension] returned [5] rows.\nquery [Column where Column isa PII] returned [3] rows.\nquery [View is Dimension] returned [2] rows.\nquery [Column select Column.name] returned [10] rows.\nquery [Column select name] returned [9] rows.\nquery [Column where Column.name=\"customer_id\"] returned [1] rows.\nquery [from Table select Table.name] returned [8] rows.\nquery [DB where (name = \"Reporting\")] returned [1] rows.\nquery [DB where DB is JdbcAccess] returned [ 0 ] rows.\nquery [DB where DB has name] returned [3] rows.\nquery [DB as db1 Table where (db1.name = \"Reporting\")] returned [ 0 ] rows.\nquery [Dimension] returned [9] rows.\nquery [JdbcAccess] returned [2] rows.\nquery [ETL] returned [10] rows.\nquery [Metric] returned [4] rows.\nquery [PII] returned [3] rows.\nquery [`Log Data`] returned [4] rows.\nquery [Table where name=\"sales_fact\", columns] returned [4] rows.\nquery [Table where name=\"sales_fact\", columns as column select column.name, column.dataType, column.comment] returned [4] rows.\nquery [from DataSet] returned [10] rows.\nquery [from Process] returned [3] rows.\nSample Lineage Info: \nsales_fact_daily_mv(Table) -> loadSalesMonthly(LoadProcess)\ntime_dim(Table) -> loadSalesDaily(LoadProcess)\nloadSalesDaily(LoadProcess) -> sales_fact_daily_mv(Table)\nloadSalesMonthly(LoadProcess) -> sales_fact_monthly_mv(Table)\nsales_fact(Table) -> loadSalesDaily(LoadProcess)\nSample data added to Apache Atlas Server.<\/pre>\n\n\n\n<p>Now you can use the atlas UI to explore and analyze the preloaded data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>I hope you liked this tutorial on installing an atlas using the docker container. Feel free to ask your valuable questions in the comments section below.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">More to read<\/h2>\n\n\n\n<p><a href=\"https:\/\/naiveskill.com\/httpd-container-using-docker\/\" target=\"_blank\" rel=\"noreferrer noopener\">Docker httpd image<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/naiveskill.com\/dockerfile-tutorial-for-beginners\/#Dockerfile_example_2\" target=\"_blank\" rel=\"noreferrer noopener\">Dockerfile tutorial for beginner<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/naiveskill.com\/jenkins-workflow\/\">Jenkins workflow<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/naiveskill.com\/jenkins-pipeline-example-hello-world\/\">Jenkins pipeline example hello-world<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As data size grows, the complexity of managing compliance and governance grows in the same proportion. This blog will understand how to install atlas in your system. What is apache &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"\" href=\"https:\/\/naiveskill.com\/install-atlas\/\"> <span class=\"screen-reader-text\">Install atlas | Complete tutorial with examples in 2023<\/span> Read More \u00bb<\/a><\/p>\n","protected":false},"author":1,"featured_media":32602,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"","footnotes":""},"categories":[66,68],"tags":[67,72,39],"uagb_featured_image_src":{"full":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas.webp",1200,628,false],"thumbnail":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas-150x150.webp",150,150,true],"medium":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas-300x157.webp",300,157,true],"medium_large":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas-768x402.webp",768,402,true],"large":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas-1024x536.webp",1024,536,true],"1536x1536":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas.webp",1200,628,false],"2048x2048":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas.webp",1200,628,false],"web-stories-poster-portrait":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas.webp",640,335,false],"web-stories-publisher-logo":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas.webp",96,50,false],"web-stories-thumbnail":["https:\/\/naiveskill.com\/wp-content\/uploads\/2021\/11\/Install_apache_atlas.webp",150,79,false]},"uagb_author_info":{"display_name":"naivetechblog@gmail.com","author_link":"https:\/\/naiveskill.com\/author\/naivetechbloggmail-com\/"},"uagb_comment_info":1,"uagb_excerpt":"As data size grows, the complexity of managing compliance and governance grows in the same proportion. This blog will understand how to install atlas in your system. What is apache &hellip; Install atlas | Complete tutorial with examples in 2023 Read More \u00bb","_links":{"self":[{"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/posts\/30696"}],"collection":[{"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/comments?post=30696"}],"version-history":[{"count":1,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/posts\/30696\/revisions"}],"predecessor-version":[{"id":36795,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/posts\/30696\/revisions\/36795"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/media\/32602"}],"wp:attachment":[{"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/media?parent=30696"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/categories?post=30696"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naiveskill.com\/wp-json\/wp\/v2\/tags?post=30696"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}