{"id":12030,"date":"2020-08-27T14:41:27","date_gmt":"2020-08-27T14:41:27","guid":{"rendered":"http:\/\/timi.eu\/?page_id=12030"},"modified":"2021-05-07T13:01:18","modified_gmt":"2021-05-07T13:01:18","slug":"etl-data-management","status":"publish","type":"page","link":"https:\/\/timi.eu\/es\/timi\/anatella\/etl-data-management\/","title":{"rendered":"ETL &#8211; Data Management"},"content":{"rendered":"<div class=\"row  \" ><div class=\"container\"><div class=\"row row-edge\">\n<div class=\"col-xs-12 col-sm-12 col-md-12 col-lg-12 pageswitcher\">\n\n<div\n\t class=\"wpml-ls-statics-shortcode_actions wpml-ls wpml-ls-legacy-dropdown js-wpml-ls-legacy-dropdown\">\n\t<ul>\n\n\t\t<li tabindex=\"0\" class=\"wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-es wpml-ls-current-language wpml-ls-item-legacy-dropdown\">\n\t\t\t<a href=\"#\" class=\"js-wpml-ls-item-toggle wpml-ls-item-toggle\">\n                                                    <img\n            class=\"wpml-ls-flag\"\n            src=\"https:\/\/timi.eu\/wp-content\/plugins\/sitepress-multilingual-cms\/res\/flags\/es.png\"\n            alt=\"\"\n            width=18\n            height=12\n    \/><span class=\"wpml-ls-native\">Espa\u00f1ol<\/span><\/a>\n\n\t\t\t<ul class=\"wpml-ls-sub-menu\">\n\t\t\t\t\n\t\t\t\t\t<li class=\"wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-en wpml-ls-first-item\">\n\t\t\t\t\t\t<a href=\"https:\/\/timi.eu\" class=\"wpml-ls-link\">\n                                                                <img\n            class=\"wpml-ls-flag\"\n            src=\"https:\/\/timi.eu\/wp-content\/plugins\/sitepress-multilingual-cms\/res\/flags\/en.png\"\n            alt=\"\"\n            width=18\n            height=12\n    \/><span class=\"wpml-ls-display\">Ingl\u00e9s<\/span><\/a>\n\t\t\t\t\t<\/li>\n\n\t\t\t\t\n\t\t\t\t\t<li class=\"wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-fr\">\n\t\t\t\t\t\t<a href=\"https:\/\/timi.eu\/fr\/\" class=\"wpml-ls-link\">\n                                                                <img\n            class=\"wpml-ls-flag\"\n            src=\"https:\/\/timi.eu\/wp-content\/plugins\/sitepress-multilingual-cms\/res\/flags\/fr.png\"\n            alt=\"\"\n            width=18\n            height=12\n    \/><span class=\"wpml-ls-display\">Franc\u00e9s<\/span><\/a>\n\t\t\t\t\t<\/li>\n\n\t\t\t\t\n\t\t\t\t\t<li class=\"wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-nl\">\n\t\t\t\t\t\t<a href=\"https:\/\/timi.eu\/nl\/\" class=\"wpml-ls-link\">\n                                                                <img\n            class=\"wpml-ls-flag\"\n            src=\"https:\/\/timi.eu\/wp-content\/plugins\/sitepress-multilingual-cms\/res\/flags\/nl.png\"\n            alt=\"\"\n            width=18\n            height=12\n    \/><span class=\"wpml-ls-display\">Holand\u00e9s<\/span><\/a>\n\t\t\t\t\t<\/li>\n\n\t\t\t\t\n\t\t\t\t\t<li class=\"wpml-ls-slot-shortcode_actions wpml-ls-item wpml-ls-item-ru wpml-ls-last-item\">\n\t\t\t\t\t\t<a href=\"https:\/\/timi.eu\/ru\/\" class=\"wpml-ls-link\">\n                                                                <img\n            class=\"wpml-ls-flag\"\n            src=\"https:\/\/timi.eu\/wp-content\/plugins\/sitepress-multilingual-cms\/res\/flags\/ru.png\"\n            alt=\"\"\n            width=18\n            height=12\n    \/><span class=\"wpml-ls-display\">Ruso<\/span><\/a>\n\t\t\t\t\t<\/li>\n\n\t\t\t\t\t\t\t<\/ul>\n\n\t\t<\/li>\n\n\t<\/ul>\n<\/div>\n\n<\/div>\n<\/div><\/div><\/div>\n<div class=\"row custom-parallax-01 \" ><section class=\"parallax-box image-parallax-box \" style=\"min-height: 300px\"><div class=\"parallax-content\"><div class=\"container\"><div class=\"row row-edge\">\n<div class=\"col-xs-12 col-sm-12 col-md-12 col-lg-12 custom-parallax-text\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:150px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:100px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:50px;\"><\/div>\n<img decoding=\"async\" class=\"aligncenter size-full wp-image-1564\" style=\"position: relative;\" src=\"\/wp-content\/uploads\/2016\/07\/logo-anatellla-min-e1468012310881.png\" alt=\"Anatella\" width=\"75\"><\/p>\n<h2 style=\"text-align: center; color: #333;\"><strong>NUNCA SE QUEDE ESPERANDO<\/strong><br \/>\nPARA UNA TRANSFORMACI\u00d3N DE DATOS<\/h2>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:200px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:150px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:100px;\"><\/div>\n<\/div>\n<\/div><\/div><div class=\"clear\"><\/div><\/div><div class=\"parallax-bg\" data-parallax-type=\"image\" data-img-url=\"\/wp-content\/uploads\/2020\/02\/leopards2b.jpg\" data-speed=\"1.5\" data-invert=\"\" ><\/div><\/section><\/div>\n<div class=\"row custom-parallax-01 \" ><div class=\"cherry-box   box-671\"><div class=\"inner\"><div class=\"container\"><div class=\"row row-edge\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:100px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:30px;\"><\/div>\n<div class=\"col-xs-12 col-sm-12 col-md-6 col-lg-6 custom-parallax-text\">\n<h2 style=\"color: #333; text-align: center;\"><strong>ORDENAMIENTO VELOZ<\/strong><br \/>\n<span style=\"color: #6c0; font-weight: 500;\">PARA UN TELECOM<\/span><\/h2>\n<p style=\"color: #000; text-align: center;\">Anatella clasifica una gran tabla CDR (Call Data Record) con mil millones de filas y 8 columnas. Esta tabla CDR de 171 GB en un archivo de texto se ordena en 99 segundos usando menos de 300 MB de RAM.<br \/>\n&nbsp;<\/p>\n<\/div>\n<div class=\"col-xs-12 col-sm-12 col-md-6 col-lg-6 custom-parallax-text\">\n<div class=\"row row-edge  \" >\n<div class=\"col-xs-0 col-sm-0 col-md-1 col-lg-1\">\n<\/div>\n<div class=\"col-xs-3 col-sm-3 col-md-3 col-lg-3\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:30px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:15px;\"><\/div>\n<div class=\"cherry-counter myclass1b myclass2\" data-delay=\"1\"  data-time=\"3000\"><span class=\"count\">1000<\/span><span class=\"after\">million rows<\/span><\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:25px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:10px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:5px;\"><\/div>\n<\/div>\n<div class=\"col-xs-3 col-sm-3 col-md-3 col-lg-3\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:30px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:15px;\"><\/div>\n<div class=\"cherry-counter myclass1b\" data-delay=\"2\"  data-time=\"6000\"><span class=\"count\">300<\/span><span class=\"after\">MB of ram<\/span><\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:25px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:10px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:5px;\"><\/div>\n<\/div>\n<div class=\"col-xs-3 col-sm-3 col-md-3 col-lg-3\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:30px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:15px;\"><\/div>\n<div class=\"cherry-counter myclass1b\" data-delay=\"1\"  data-time=\"3000\"><span class=\"count\">99<\/span><span class=\"after\">seconds<\/span><\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:25px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:10px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:5px;\"><\/div>\n<\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:100px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:30px;\"><\/div>\n<\/div>\n<\/div>\n<div class=\"col-xs-12 col-sm-12 col-md-12 col-lg-12 custom-parallax-text\">\n<div class=\"cherry-accordion  \">\n<div class=\"cherry-spoiler cherry-spoiler-style-default morevalue1  cherry-spoiler-closed\"><div class=\"cherry-spoiler-title\">M\u00e1s...<\/div><div class=\"cherry-spoiler-content cherry-clearfix\" style=\"display:none\">\n<a class=\"single-popup-image\" href=\"\/wp-content\/uploads\/2016\/09\/demo_sort.png\"><img decoding=\"async\" class=\"alignright size-full wp-image-6059\" src=\"\/wp-content\/uploads\/2016\/09\/demo_sort.png\" alt=\"demo_sort\" width=\"50%\" srcset=\"https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/demo_sort.png 851w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/demo_sort-600x490.png 600w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/demo_sort-300x245.png 300w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/demo_sort-768x627.png 768w\" sizes=\"(max-width: 851px) 100vw, 851px\" \/><\/a>Un tipo similar tomar\u00eda 5 horas si se ejecuta en una base de datos l\u00edder bien conocida.<\/p>\n<p>La tabla de CDR proviene de una telecomunicaci\u00f3n con 6 millones de abonados. Almacenado en una base de datos, pesa cerca de 2 TB.<\/p>\n<p>La tabla inicial del CDR est\u00e1 compuesta por 42 archivos diferentes (en formato .gel_anatella), es decir, mil millones de l\u00edneas o 42 d\u00edas de datos en total. Anatella clasifica la tabla de CDR en la columna A (que contiene m\u00e1s de 6 millones de n\u00fameros de tel\u00e9fono diferentes). Este gr\u00e1fico de transformaci\u00f3n de datos se clasifica en un ordenador port\u00e1til:<\/p>\n<p><img decoding=\"async\" class=\"alignleft size-full wp-image-4832\" src=\"\/wp-content\/uploads\/2016\/09\/sort-1.png\" alt=\"sort\" width=\"500\" srcset=\"https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/sort-1.png 803w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/sort-1-600x69.png 600w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/sort-1-300x34.png 300w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/sort-1-768x88.png 768w\" sizes=\"(max-width: 803px) 100vw, 803px\" \/><br \/>\n<\/div><\/div>\n<\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:100px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:30px;\"><\/div>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div>\n<div class=\"row custom-parallax-01 \" ><div class=\"cherry-box   box-687\"><div class=\"inner\"><div class=\"container\"><div class=\"row row-edge\">\n<div class=\"col-xs-12 col-sm-12 col-md-6 col-lg-6 custom-parallax-text\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:100px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:75px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:50px;\"><\/div>\n<div class=\"row row-edge  \" >\n<div class=\"col-xs-0 col-sm-0 col-md-1 col-lg-1\">\n<\/div>\n<div class=\"col-xs-3 col-sm-3 col-md-3 col-lg-3\">\n<div class=\"cherry-counter myclass1 myclass2\" data-delay=\"1\"  data-time=\"3000\"><span class=\"count\">1300<\/span><span class=\"after\">million rows<\/span><\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:25px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:10px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:5px;\"><\/div>\n<\/div>\n<div class=\"col-xs-3 col-sm-3 col-md-3 col-lg-3\">\n<div class=\"cherry-counter myclass1\" data-delay=\"2\"  data-time=\"6000\"><span class=\"count\">150<\/span><span class=\"after\">MB of ram<\/span><\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:25px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:10px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:5px;\"><\/div>\n<\/div>\n<div class=\"col-xs-3 col-sm-3 col-md-3 col-lg-3\">\n<div class=\"cherry-counter myclass1\" data-delay=\"1\"  data-time=\"3000\"><span class=\"count\">70<\/span><span class=\"after\">seconds<\/span><\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:25px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:10px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:5px;\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"col-xs-12 col-sm-12 col-md-6 col-lg-6 custom-parallax-text\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:70px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:30px;\"><\/div>\n<h2 style=\"color: #333; text-align: center;\"><strong>AGREGACIONES<\/strong><br \/>\n<span style=\"color: #6c0; font-weight: 500;\">PARA UN SUPERMERCADO<\/span><\/h2>\n<p style=\"color: #000; text-align: center;\">A partir de la tabla de recibos (1.300 millones de filas y 17 columnas), Anatella calcula el siguiente agregado: el porcentaje de compras en la Web. Este KPI se realiza en 70 segundos usando menos de 50 MB de RAM.<\/p>\n<\/div>\n<div class=\"col-xs-12 col-sm-12 col-md-12 col-lg-12 custom-parallax-text\">\n<div class=\"cherry-accordion  \">\n<div class=\"cherry-spoiler cherry-spoiler-style-default morevalue2  cherry-spoiler-closed\"><div class=\"cherry-spoiler-title\">M\u00e1s...<\/div><div class=\"cherry-spoiler-content cherry-clearfix\" style=\"display:none\">\n<a class=\"single-popup-image\" href=\"\/wp-content\/uploads\/2016\/09\/retail.png\"><img decoding=\"async\" class=\"alignleft size-full wp-image-6060\" style=\"padding-bottom: 110px;\" src=\"\/wp-content\/uploads\/2016\/09\/retail.png\" alt=\"retail\" width=\"50%\" srcset=\"https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/retail.png 1536w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/retail-600x361.png 600w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/retail-300x181.png 300w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/retail-768x463.png 768w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/retail-1024x617.png 1024w\" sizes=\"(max-width: 1536px) 100vw, 1536px\" \/><\/a>La tabla de boletos contiene todas las compras realizadas por m\u00e1s de 1 mill\u00f3n de clientes durante 2 a\u00f1os a la escala m\u00e1s fina (una l\u00ednea de la tabla representa la compra de un producto).<\/p>\n<p>Primero extrajimos esta tabla de entradas de Teradata (m\u00e1s de 2 TB en la base de datos) para obtener un archivo .sas7bdat de 450 GB. Luego, usando Anatella, convertimos este archivo .sas7bdat en un archivo .cgel_anatella de 23GB m\u00e1s compacto. Este nuevo archivo se utiliz\u00f3 como base para calcular el porcentaje de compras en la Web. Este gr\u00e1fico de transformaci\u00f3n de datos de Anatella produce el agregado solicitado:<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-5028\" src=\"\/wp-content\/uploads\/2016\/09\/aggr1.png\" alt=\"aggr1\" width=\"500\" srcset=\"https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/aggr1.png 660w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/aggr1-600x89.png 600w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/aggr1-300x45.png 300w\" sizes=\"(max-width: 660px) 100vw, 660px\" \/><br \/>\n<\/div><\/div>\n<\/div>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:70px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:30px;\"><\/div>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div>\n<div class=\"row custom-parallax-01 \" ><div class=\"cherry-box   box-440\"><div class=\"inner\"><div class=\"container\"><div class=\"row row-edge\">\n<div class=\"col-xs-12 col-sm-4 col-md-4 col-lg-4\">\n<\/div>\n<div class=\"col-xs-12 col-sm-4 col-md-4 col-lg-4 custom-parallax-text\">\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:30px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:15px;\"><\/div>\n<h2 style=\"text-align: center;\"><strong>NOTA<\/strong><\/h2>\n<p style=\"text-align: center;\">Todos los ejemplos mencionados en esta p\u00e1gina funcionan en este port\u00e1til:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-large wp-image-4830\" src=\"\/wp-content\/uploads\/2016\/09\/msi-1-1024x770.png\" alt=\"msi\" width=\"1024\" height=\"770\" srcset=\"https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/msi-1-1024x770.png 1024w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/msi-1-600x451.png 600w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/msi-1-300x226.png 300w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/msi-1-768x578.png 768w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/msi-1-200x150.png 200w, https:\/\/timi.eu\/wp-content\/uploads\/2016\/09\/msi-1.png 1073w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><br \/>\n<div class=\"cherry-spacer   hidden-xs hidden-sm\" style=\"height:50px;\"><\/div><div class=\"cherry-spacer   visible-sm-block\" style=\"height:30px;\"><\/div><div class=\"cherry-spacer   visible-xs-block\" style=\"height:15px;\"><\/div>\n<\/div>\n<div class=\"col-xs-12 col-sm-4 col-md-4 col-lg-4\">\n<\/div>\n<\/div><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":12028,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/pages\/12030"}],"collection":[{"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/comments?post=12030"}],"version-history":[{"count":2,"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/pages\/12030\/revisions"}],"predecessor-version":[{"id":13536,"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/pages\/12030\/revisions\/13536"}],"up":[{"embeddable":true,"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/pages\/12028"}],"wp:attachment":[{"href":"https:\/\/timi.eu\/es\/wp-json\/wp\/v2\/media?parent=12030"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}