{"id":3548,"date":"2025-01-22T11:54:31","date_gmt":"2025-01-22T11:54:31","guid":{"rendered":"https:\/\/mooddie.pt\/?page_id=3548"},"modified":"2025-02-13T14:56:38","modified_gmt":"2025-02-13T14:56:38","slug":"implementacao-de-um-data-lake-100-open-source","status":"publish","type":"page","link":"https:\/\/mooddie.pt\/pt\/cases\/implementacao-de-um-data-lake-100-open-source\/","title":{"rendered":"Implementa\u00e7\u00e3o de um Data Lake 100% Open-Source"},"content":{"rendered":"[vc_row type=”full_width_background” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_image=”3503″ bg_position=”center center” background_image_loading=”default” bg_repeat=”no-repeat” scene_position=”center” mouse_sensitivity=”25″ layer_one_image=”2775″ text_color=”light” text_align=”center” row_border_radius=”none” row_border_radius_applies=”bg” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” enable_shape_divider=”true” shape_divider_color=”#ffffff” shape_divider_position=”bottom” shape_divider_height=”90px” bg_image_animation=”none” gradient_type=”default” shape_type=”tilt_alt”][vc_column top_padding_desktop=”200px” bottom_padding_desktop=”140px” column_element_direction_desktop=”default” column_element_spacing=”default” centered_text=”true” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” column_position=”default” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid” column_padding_type=”advanced” gradient_type=”default”][nectar_responsive_text inherited_font_style=”default” text_color=”#ffffff” font_size_desktop=”66px” font_line_height=”70px” text_direction=”default” class_name=”fontinter”]\n

Beyond solutions
\nthere\u2019s knowledge<\/span><\/p>\n[\/nectar_responsive_text][\/vc_column][\/vc_row][vc_row type=”in_container” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#ffffff” scene_position=”center” left_padding_phone=”30″ right_padding_phone=”30″ text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” overflow=”visible” class=”box_cases” overlay_strength=”0.3″ gradient_direction=”left_to_right” shape_divider_position=”bottom” bg_image_animation=”none” gradient_type=”default” shape_type=””][vc_column column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”right” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” column_position=”default” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid” column_padding_type=”default” gradient_type=”default”][nectar_btn size=”small” button_style=”regular” button_color_2=”Accent-Color” icon_family=”fontawesome” el_class=”roundbtn” text=”Voltar aos casos de estudo” url=”\/pt\/cases” icon_fontawesome=”fa fa-chevron-left” margin_top=”80″][\/vc_column][\/vc_row][vc_row type=”in_container” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#ffffff” scene_position=”center” top_padding=”40″ bottom_padding=”80″ left_padding_phone=”30″ right_padding_phone=”30″ text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” overflow=”visible” class=”textjustify box_cases” overlay_strength=”0.3″ gradient_direction=”left_to_right” shape_divider_position=”bottom” bg_image_animation=”none” gradient_type=”default” shape_type=””][vc_column column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color=”#ffffff” background_color_opacity=”1″ background_color_hover=”#ffffff” background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” column_position=”default” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid” column_padding_type=”default” gradient_type=”default”][nectar_responsive_text inherited_font_style=”h3″ text_color=”#000000″ text_direction=”default” font_size_desktop=”28px”]\n

Implementa\u00e7\u00e3o de um<\/span> Data Lake 100% Open-Source<\/h3>\n[\/nectar_responsive_text][divider line_type=”No Line” custom_height=”60px”][nectar_responsive_text inherited_font_style=”h4″ text_color=”#0069ff” text_direction=”default” font_size_desktop=”24px”]\n

Introdu\u00e7\u00e3o<\/h4>\n[\/nectar_responsive_text][vc_column_text css=”” text_direction=”default”]Para impulsionar a rentabilidade e a inova\u00e7\u00e3o digital, o nosso cliente, uma entidade financeira (Banco), apostou na moderniza\u00e7\u00e3o da sua infraestrutura de dados impulsionando a sua efici\u00eancia operacional, rentabilidade e disrup\u00e7\u00e3o digital. A significativa complexidade em integrar dados estruturados e n\u00e3o estruturados para an\u00e1lises preditivas e efici\u00eancia das suas estrat\u00e9gias de cross-selling, era um desafio crucial.
\nComo a Mooddie Digital Data Consulting (Mooddie) ajudou o seu cliente a transformar a sua infraestrutura de dados, fornecendo uma solu\u00e7\u00e3o moderna e escal\u00e1vel, um Data Lake 100% open-source, que impulsionou o cross-selling de produtos. Descubra como!<\/strong>[\/vc_column_text][divider line_type=”No Line” custom_height=”60px”][nectar_responsive_text inherited_font_style=”h4″ text_color=”#0069ff” text_direction=”default” font_size_desktop=”24px”]\n

O Desafio:
\nInfraestrutura de Dados Complexa<\/span><\/h4>\n[\/nectar_responsive_text][vc_column_text css=”” text_direction=”default”]O cliente enfrentava dificuldades relacionadas com a gest\u00e3o e an\u00e1lise de grandes volumes de dados. A aus\u00eancia de uma infraestrutura adequada dificultava a obten\u00e7\u00e3o de insights valiosos tornando dif\u00edcil a an\u00e1lise de comportamento e a defini\u00e7\u00e3o de ofertas direcionadas. Era crucial uma solu\u00e7\u00e3o que garantisse armazenamento e processamento eficientes, al\u00e9m da flexibilidade, seguran\u00e7a, escalabilidade e sobretudo, acesso r\u00e1pido \u00e0 informa\u00e7\u00e3o e aos respetivos indicadores relevantes para cada situa\u00e7\u00e3o.<\/p>\n

Como a Mooddie ajudou o seu cliente a transformar a sua infraestrutura de dados, fornecendo uma solu\u00e7\u00e3o moderna e escal\u00e1vel, um Data Lake 100% open-source, que impulsionou o cross-selling de produtos.[\/vc_column_text][divider line_type=”No Line” custom_height=”60px”][nectar_responsive_text inherited_font_style=”h4″ text_color=”#0069ff” text_direction=”default” font_size_desktop=”24px”]\n

A Solu\u00e7\u00e3o
\nData Lake Estruturado para Cross-Selling, 100% Open-Source<\/span><\/h4>\n[\/nectar_responsive_text][vc_column_text css=”” text_direction=”default”]A Mooddie projetou e implementou uma arquitetura moderna de Big Data que centralizou, consolidou e organizou os dados estruturados e n\u00e3o estruturados, de forma eficiente, fornecendo uma base s\u00f3lida para an\u00e1lises detalhadas e indicadores essenciais para o cross-selling de produtos e servi\u00e7osdo banco, onde se destacou 3 principais pilares no processo de implementa\u00e7\u00e3o:[\/vc_column_text][divider line_type=”No Line” custom_height=”30px”][vc_column_text css=”” text_direction=”default”]1. Desenho de uma Arquitetura Moderna e Escal\u00e1vel<\/strong>
\nConstru\u00edmos uma arquitetura de Big Data baseada em tecnologias atuais e open-source, como Apache Spark, Kafka, Hadoop\/HDFS, Apache HOP e Kubernetes, garantindo processamento em tempo real e armazenamento otimizado.<\/span>
\n2. Integra\u00e7\u00e3o de Fontes de Dados<\/strong>
\nDados de v\u00e1rias fontes internas foram consolidados em camadas estruturadas (bronze, silver e gold).Cada tabela foi analisada, reorganizada e ajustada para permitir cruzamentos precisos e relevantes.<\/span>
\n3. Desenvolvimento de Indicadores Personalizados<\/strong>
\nCom base nas necessidades do cliente, foram definidos indicadores espec\u00edficos para avalia\u00e7\u00e3o de elegibilidade para aplica\u00e7\u00e3o de estrat\u00e9gias de cross-selling. Tendo sido desenvolvidos dashbaords din\u00e2micos e intuitivos, apresentando uma vis\u00e3o clara do desempenho dos indicadores.<\/span>[\/vc_column_text][divider line_type=”No Line” custom_height=”60px”][nectar_responsive_text inherited_font_style=”h4″ text_color=”#0069ff” text_direction=”default” font_size_desktop=”24px”]\n

O Resultado<\/h4>\n[\/nectar_responsive_text][vc_column_text css=”” text_direction=”default”]Cross-Selling Baseado em Dados<\/strong>
\nO cliente passou a identificar, de forma autom\u00e1tica, clientes com maior potencial para adquirir novos produtos, aumentando a taxa de convers\u00e3o de campanhas.<\/span>
\nMelhoria na Gest\u00e3o de Relacionamento com o Cliente<\/strong>
\nCom uma vis\u00e3o integrada de cada cliente, a equipa do cliente conseguiu oferecer produtos personalizados e criar campanhas mais relevantes.<\/span>
\nDecis\u00f5es Baseadas em Indicadores Fi\u00e1veis<\/strong>
\nIndicadores precisos e atualizados em tempo real permitiram decis\u00f5es estrat\u00e9gicas r\u00e1pidas e informadas.<\/span>
\nCeleridade na obten\u00e7\u00e3o da informa\u00e7\u00e3o<\/strong>
\nA arquitetura implementada garante celeridade na obten\u00e7\u00e3o de grandes volumes de dados, possibilitando o lan\u00e7amento r\u00e1pido de campanhas e refor\u00e7ando a competitividade do banco.<\/span>[\/vc_column_text][divider line_type=”No Line” custom_height=”60px”][image_with_animation image_url=”3554″ image_size=”full” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” max_width=”100%” max_width_mobile=”default”][divider line_type=”No Line” custom_height=”60px”][nectar_responsive_text inherited_font_style=”h4″ text_color=”#0069ff” text_direction=”default” font_size_desktop=”24px”]\n

Conclus\u00e3o:<\/h4>\n[\/nectar_responsive_text][nectar_responsive_text inherited_font_style=”h4″ text_color=”#000000″ text_direction=”default” font_size_desktop=”24px”]\n

Infraestrutura de Dados Pronta para o Futuro<\/h4>\n[\/nectar_responsive_text][vc_column_text css=”” text_direction=”default”]A implementa\u00e7\u00e3o do Data Lake resultou numa infraestrutura de integra\u00e7\u00e3o de dados robusta, capaz de consolidar m\u00faltiplas fontes de informa\u00e7\u00e3o de forma estruturada, eficiente e c\u00e9lere. A arquitetura moderna foi desenhada para garantir escalabilidade e flexibilidade, estando preparada para uma poss\u00edvel migra\u00e7\u00e3o para a cloud que se entende vir a ser o futuro. De qualquer forma, o nosso cliente encontra-se agora equipado, para processar grandes volumes de dados, criar indicadores personalizados, desenvolver an\u00e1lises avan\u00e7adas, permitindo o lan\u00e7amento de campanhas com agilidade, promovendo decis\u00f5es estrat\u00e9gicas informadas e impulsionando a inova\u00e7\u00e3o cont\u00ednua. [\/vc_column_text][\/vc_column][\/vc_row][vc_row type=”full_width_content” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_color=”#0069ff” scene_position=”center” text_color=”dark” text_align=”left” row_border_radius=”none” row_border_radius_applies=”bg” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” enable_shape_divider=”true” shape_divider_color=”#ffffff” shape_divider_position=”top” shape_divider_height=”40px” shape_divider_bring_to_front=”true” bg_image_animation=”none” gradient_type=”default” shape_type=”tilt_alt”][vc_column top_padding_desktop=”80px” bottom_padding_desktop=”100px” column_element_direction_desktop=”default” column_element_spacing=”default” centered_text=”true” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” column_position=”default” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/1″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid” column_padding_type=”advanced” gradient_type=”default”][vc_row_inner column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” text_align=”center” row_position=”default” row_position_tablet=”inherit” row_position_phone=”inherit” overflow=”visible” pointer_events=”all”][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/3″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][image_with_animation image_url=”3546″ image_size=”full” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” max_width=”custom” max_width_custom=”140px”][divider line_type=”No Line” custom_height=”15″][nectar_responsive_text inherited_font_style=”default” text_color=”#ffffff” font_size_desktop=”13px” text_direction=”default” font_line_height=”16px”]Transforma\u00e7\u00e3o Inteligente
\n<\/span>de Dados Digitais<\/span>[\/nectar_responsive_text][\/vc_column_inner][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/3″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][image_with_animation image_url=”3560″ image_size=”full” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” max_width=”custom” max_width_custom=”140px”][divider line_type=”No Line” custom_height=”15″][nectar_responsive_text inherited_font_style=”default” text_color=”#ffffff” font_size_desktop=”13px” text_direction=”default” font_line_height=”16px”]Estrat\u00e9gias e Arquitetura de TI<\/span>[\/nectar_responsive_text][\/vc_column_inner][vc_column_inner column_padding=”no-extra-padding” column_padding_tablet=”inherit” column_padding_phone=”inherit” column_padding_position=”all” column_element_direction_desktop=”default” column_element_spacing=”default” desktop_text_alignment=”default” tablet_text_alignment=”default” phone_text_alignment=”default” background_color_opacity=”1″ background_hover_color_opacity=”1″ column_backdrop_filter=”none” column_shadow=”none” column_border_radius=”none” column_link_target=”_self” overflow=”visible” gradient_direction=”left_to_right” overlay_strength=”0.3″ width=”1\/3″ tablet_width_inherit=”default” animation_type=”default” bg_image_animation=”none” border_type=”simple” column_border_width=”none” column_border_style=”solid”][image_with_animation image_url=”3562″ image_size=”full” animation_type=”entrance” animation=”None” animation_movement_type=”transform_y” hover_animation=”none” alignment=”center” border_radius=”none” box_shadow=”none” image_loading=”default” max_width=”custom” max_width_custom=”123px”][divider line_type=”No Line” custom_height=”15″][nectar_responsive_text inherited_font_style=”default” text_color=”#ffffff” font_size_desktop=”13px” text_direction=”default” font_line_height=”16px”]Consultoria Funcional<\/span>[\/nectar_responsive_text][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row]\n","protected":false},"excerpt":{"rendered":"

[vc_row type=”full_width_background” full_screen_row_position=”middle” column_margin=”default” column_direction=”default” column_direction_tablet=”default” column_direction_phone=”default” bg_image=”3503″ bg_position=”center center” background_image_loading=”default” bg_repeat=”no-repeat” scene_position=”center” mouse_sensitivity=”25″ layer_one_image=”2775″ text_color=”light” text_align=”center” row_border_radius=”none” row_border_radius_applies=”bg” overflow=”visible” overlay_strength=”0.3″ gradient_direction=”left_to_right” enable_shape_divider=”true” shape_divider_color=”#ffffff” shape_divider_position=”bottom” shape_divider_height=”90px” bg_image_animation=”none” gradient_type=”default” shape_type=”tilt_alt”][vc_column top_padding_desktop=”200px”…<\/p>\n","protected":false},"author":3,"featured_media":0,"parent":3477,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"inline_featured_image":false,"footnotes":""},"class_list":["post-3548","page","type-page","status-publish"],"_links":{"self":[{"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/pages\/3548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/comments?post=3548"}],"version-history":[{"count":23,"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/pages\/3548\/revisions"}],"predecessor-version":[{"id":3800,"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/pages\/3548\/revisions\/3800"}],"up":[{"embeddable":true,"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/pages\/3477"}],"wp:attachment":[{"href":"https:\/\/mooddie.pt\/pt\/wp-json\/wp\/v2\/media?parent=3548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}