What’s Driving the Data Lake?

first_imgEMC’s Federation Business Data Lake (FBDL) announcement has been a long time in the making.  It’s been a perfect storm of industry trends that enable big data and make data lakes a feasible data architecture option.  These trends include:Data Growth – Web applications, social media, mobile apps, sensors, scanners, wearable computing and the Internet of Things are all generating an avalanche of new, more granular data about customers, channels, products and operations that can now be captured, integrated, mined and acted upon.Cheap Storage – The cost of storage is plummeting, which enables organizations to think differently about data. Leading organizations are transitioning from viewing data as a cost to be minimized to valuing it as an asset to be hoarded. Even if they don’t yet know how they will use that data, they are transitioning to a “data abundance” mentality.Limitless Computing – The ability to bring to bear an almost limitless amount of computing power to any business problem allows organizations to process, enrich and analyze this growing wealth of data, uncovering actionable insights about their customers and their business operations.Real-time Technologies – Low-latency data access and analysis is enabling organizations to identify and monetize “events in the moment” while there is still value in the freshness or recency of the event.While this list is impressive, it is not complete. There are two other key industry trends that are driving big data and the data lake:Open Source Software is democratizing software tools like Hadoop, R, Shark, YARN, Mahout, and MADlib, by putting these tools within the reach of any organization.  Open source software is fueling innovation from startups and Fortune 500 organizations to universities and digital media companies; it is liberating organizations from being held captive by the product development cycles of traditional enterprise software vendors.Many smart people have been working hard to pull the FBDL together and I am proud to say that I saw the data lake coming as early as May 2012 when I published my “Understanding the Role of Hadoop In Your BI Environment” blog post.  Okay, okay, I originally called it an Hadoop-based “Operational Data Store,” but regardless of missing on the name, I got many of the key benefits right:Hadoop brings at least two significant advantages to your ETL and data staging processes.  The first is the ability to ingest massive amounts of data as-is. That means that you do not need to pre-define the data schema before loading data into Hadoop. This includes both traditional transactional data (e.g., point-of-sale transactions, call detail records, general ledger transactions, call center transactions), but also unstructured internal data (like consumer comments, doctor’s notes, insurance claims descriptions, and web logs) and external social media data (from social media sites such LinkedIn, Pinterest, Facebook and Twitter).  So regardless of the structure of your incoming data, you can rapidly load it all into Hadoop, as-is, where it then becomes available for your downstream ETL, DW, and analytic processes.My original “data lake” graphicThe second advantage that Hadoop brings to your BI/DW architecture occurs once the data is in the Hadoop environment.  Once it’s in your Hadoop ODS, you can leverage the inherently parallel nature of Hadoop to perform your traditional ETL work of cleansing, normalizing, aligning, and creating aggregates for your EDW at massive scale.And finally, Data Science, which is the most exciting industry trend for me.  Analytic tools combined with the volume, variety and velocity of data are converging with training and education, business-centric methodologies, and innovative thinking to enable organizations to “weave data hay into business gold” by uncovering customer, product and operational insights from data lakes that can be used to optimize key business processes and uncover new monetization opportunities.What Does the Future Hold?EMC’s Federation Business Data Lake takes a big step in the maturation of data lakes by leveraging big data industry trends to create a living “interconnected tissue” entity.  The features outlined in the FBDL will fuel the business transformational processes that we are already seeing underway at many clients.  But there still is a long way to go as tools, training and methodologies continue to evolve, helping organizations think differently about the role of data and analytics to power their value creation processes.last_img read more


Connectivity Made Simple with MyService360

first_imgInclusion of Additional ProductsYour inventory list in the ‘Connectivity’ section will now include software products that are capable of connecting home (i.e. sending files home to Dell EMC).  Review the ‘Not Connected’ view within this section (Figure 2) to see which of your hardware and software products are capable of connecting home to Dell EMC, and take action to connect your systems appropriately. Dell EMC recommends connecting your eligible systems via ESRS v3 to maximize your product performance.  Learn more about this proactive, remote monitoring capability and how to get connected below.New Representation of Connection TypesThe connection types displayed within your view have now been grouped as ‘ESRS’ and ‘Other’, helping you to hone in on the most relevant information to you.  Reference the products in the ‘Connected’ section with an ‘Other’ connection to identify opportunities for an upgrade to ESRS for optimal connectivity.  You can reference a list of ESRS-supported products here.Note: The ‘Connected via Other’ category includes email, dial home, and connection channels for products acquired by legacy EMC. While these are valid connection channels, ESRS is considered the gold-standard of connectivity for your eligible legacy EMC products.Get Connected with Secure Remote Services (ESRS)Prevent unplanned interruptions to your data and IT environment, by connecting your eligible products with ESRS v3.  Secure Remote Services (ESRS v3) is a highly secure, two-way remote connection between your legacy EMC products and Dell EMC Customer Service.  By enabling continuous remote monitoring and proactive remote troubleshooting, ESRS helps ensure the health of your environment behind the scenes, so you can focus on your business objectives.  ESRS also enriches your MyService360 experience by creating a consistent, secure data feed back to Dell EMC, ensuring that the data you access, such as code levels, is current and high-value.Let Dell EMC help take the guesswork out of maintaining a healthy IT environment.  Visit the getting started page and enable ESRS v3 for your eligible products listed as ‘Not Connected’ in the ‘Connectivity’ section of MyService360, today.Need Help?Reference the ESRS Forum within the Dell EMC Community Network for quick guides and reference materials when connecting your systems with ESRS.Ensuring the accuracy of your data is our priority.  Please open a Service Request if you have any data-specific questions.Should you have any other questions or feedback on your online experience, please submit them through the Help and Feedback form.For detailed instructions on using the ‘Connectivity’ section of MyService360, please visit the Help Page.Lauren ContiDell EMCProduct Marketing ManagerFollow us @DellEMCSupport While product connectivity plays a crucial role in maintaining a healthy IT environment, Dell EMC knows it can be complicated at times to understand all of its facets. You may find yourself asking questions like “What does it mean if my product is ‘connected’?”, “How do I know which of my products can get connected?”, or “How do I connect my systems?”. To address these questions and create a simpler, more transparent online service experience, Dell EMC has introduced a revised set of data rules and definitions for the ‘Connectivity’ section of your MyService360 dashboard.Key Elements of Your Enhanced ‘Connectivity’ View: ConnectedDell EMC has received an incoming file(s) – i.e. the product has ‘connected home’ – via ESRS, email, or other connection channel.There are two product-specific exceptions to this definition:Isilon – As Isilon products are clustered systems, the connectivity status of an Isilon product is determined at the cluster level.Data Domain – Unless reconfigured to adopt ESRS connectivity, the device may be presumed to be connected due to a proprietary connectivity solution integrated into Data Domain devices. Simplified Definition of ConnectivityTo make it easier to quickly assess which of your products are connected, the ‘Connectivity’ section of MyService360 now uses these more straightforward connection status definitions for your products: Not ConnectableYour system is not capable of sending file(s) or device data to Dell EMC.With some product exceptions, your system may be connected via a related system, for example, a clustered configuration.center_img Not ConnectedDell EMC has not received an incoming file(s) via ESRS, email or other connection channel.Note: You may have declined the option to send system files or device data to Dell EMC, or you have not yet established connectivity with Dell EMC for your device.  Read on to learn how to connect your eligible systems. Please note that the following information pertains to your legacy EMC Install Base.  Connectivity is defined using different parameters for your legacy Dell equipment.  Modified Connectivity MeasurementWith these revised data rules and definitions surrounding connectivity, your connectivity rates will now be measured based on the total population of products in your Install Base that are capable of connecting home.  Please note that this modified measurement may adjust the percentages of ‘Connected’ and ‘Not Connected’ systems you see in the initial ‘Connectivity at a Glance’ view within this section (Figure 1).last_img read more


Extend Your Storage Offerings with the New Dell EMC ECS EX-Series

first_imgEX3000: Packing up to 8.6 PB in a single rack, the EX3000 is designed to support organizations with a large data footprint. This makes it the ideal solution for archiving warm and cold data, building internal cloud-storage portals, and supporting large cloud-native apps as well as Internet of Things (IoT) or analytics initiatives. Due to its superior storage density (almost 50% higher than previous ECS platforms), the EX3000 is a great fit for datacentre consolidation efforts. EX-Series offers you the flexibility to grow your business based on your customer needs. You can now offer your customers:Jump on this opportunity to extend the storage offerings you sell your customers today and reap the benefits! As the digital economy extends its reach, organizations are beginning to appreciate the value of data. Data is playing an increasingly important role in determining whether organizations will thrive in a digital-first world or not. According to IDC’s prediction, worldwide spending on digital transformation technologies is growing at 18.1% through 2021 to more than $1.8 trillion¹. To truly unlock the value of data, however, your customers need a fundamentally different approach to IT, as traditional infrastructure was not built to handle the magnitude of data. This is precisely why we built Dell EMC ECS, the modern object-storage platform that brings cloud scale and economics to our customers’ datacenters.We are introducing the new ECS EX-Series platform, the next-generation ECS hardware that can help open up new sales opportunities for you to up-sell support and consultancy services.A data storage platform for now – and for the futureECS brings public cloud-like scalability and flexibility that can meet your customers’ data storage needs of today and tomorrow. The EX-Series release consists of two brand new offerings: EX300: With a minimum starting capacity of just 60TB (83% lower than previous ECS platforms), the EX300 is the perfect storage platform for cloud-native initiatives, such as apps built using Pivotal Cloud Foundry (PCF). The EX300 is also well suited for modernizing Dell EMC Centera environments. Watch the ECS Introduction Video, go to the ECS Website for more ECS resources and visit the Partner Portal for more partner-specific resources. 1.     Greater Flexibility: The EX-series provides organizations with unparalleled flexibility in starting with just the capacity they need, and growing as their needs change in the future.2.     Centera Modernization: With a minimum starting capacity of 60TB, the EX-series can help your customers accelerate Centera modernization efforts. Thanks to its native support of the CAS API, ECS supports seamless migration from Centera. It also honours governance, compliance and retention features that Centera customers rely on.3.    Future-Proof: The new EX-series provides open-standard based switches with up to 100GbE I/O per port connectivity and the ability to tune performance requirements.4.     Storage for Pivotal Cloud Foundry (PCF): ECS enables developers to provision storage, providing a flexible, API accessible and persistent object storage system for PCF apps. Partner benefitslast_img read more


IoT Solution for Surveillance at VMworld Europe

first_imgDell Technologies recently announced the Dell Technologies IoT Solution | Surveillance at VMworld in Las Vegas. The solution will also be highlighted at VMworld Europe in Barcelona and discussed in a breakout session by Frank McCarthy, Dell EMC CTO for Surveillance Solutions.The IoT Solution | Surveillance is the first Dell Technologies branded IoT solution to hit the market.  The solution set is built with a hyper-converged, high performance, ingest storage tier and a dense secondary storage tier, designed to meet multi-petabyte storage requirements.  The hyper-converged ingest storage tier is engineered to handle the most demanding enterprise video ingest performance requirements needed for surveillance applications. This hyper-converged system allows customers to reduce the amount of compute and storage hardware for large scale deployments and seamlessly scales out as the system requirements increase. This addresses the need for a surveillance infrastructure to accommodate  the increasingly higher resolution cameras that customers are deploying while maximizing performance and keep the hardware footprint to a minimum.  The second tier of high-density storage can provide even greater scale and can be deployed as private and/or hybrid cloud storage.  Both storage tiers are software defined, utilizing Dell EMC appliances that have been designed and sized specifically for the surveillance workload.The IoT Solution | Surveillance is an engineered solution that was tested, designed and validated in the Dell EMC Surveillance Labs in collaboration with Dell Technologies companies and business units.  This innovative solution is an example of the collaborative spirit that exists within Dell Technologies to combine best of breed products into a solution that addresses the challenges our customer face in the surveillance industry.Future versions of the IoT Solution | Surveillance will allow for analytic application support, heterogenous surveillance camera management capabilities and end to end system orchestration of the entire system.To learn more about the IoT Solution for Surveillance check out the following link :, plan to attend the breakout session with Frank McCarthy on Thursday 11/8 at VMworld Barcelona.Frank McCarthy s the Global CTO of Surveillance Solutions at Dell EMC. For the past 12 years he has been responsible for all facets of solution development and rationalization of Dell EMC’s products for the surveillance industry. The Surveillance team published Dell EMC’s first surveillance reference architecture in 2006 and they have helped propel Dell EMC to an industry leading infrastructure provider in surveillance. Frank and his team designed, engineered, and performed the validation testing for the Dell Technologies IoT Solution | Surveillance.  Frank has 28 years’ experience as an IT professional and is committed to ensuring that Dell Technologies solutions are designed and tested to handle the surveillance industries most demanding requirements.last_img read more


3 Things to Consider Before Going All-In on Public Cloud

first_imgHow much of your business is run in the public cloud?You’ll probably say somewhere between none and all. Only a tiny fraction of businesses run either all on-premises or all in the public cloud. For the most part, IT departments just aren’t at the extremes. They run a hybrid infrastructure – a mix of on-premises and public cloud compute. But, why?Some businesses run a hybrid infrastructure because they choose to.They don’t listen to hype like “the data center is dead.” They rationally looked at their environment, their industry, their business, their objectives, and their workloads to decide what’s best for them. They discovered that a hybrid IT model provides them with the most of many things. Things like flexibility. The most control over things like security and costs. If you were to ask, they’d tell you they run a hybrid infrastructure because certain workloads are more suited for running on-premises, while others are better suited for the public cloud.Some businesses run a hybrid infrastructure because they have to.They are on a journey to move everything to the public cloud. But not everything is movable, yet. So they are stuck. The number of applications running on-premises is dwindling, but they still have to keep the data center operational. These businesses spend a big chunk of their effort trying to abandon their on-premises infrastructure.Why are some businesses planning to move everything to the public cloud?For some, the public cloud’s sweet siren songs about things like unlimited capacity and scalability are irresistible. Others see the public cloud as a cure for what ails their on-premises data center. It’s important to remember that an all-in public cloud approach doesn’t immunize you from all the problems plaguing your on-premises environment.Changing people, process, and technology in current on-premises environments is hard. It can be really hard with outdated IT equipment and no upper-management support for investing in the data center. So, they opt for a clean slate to draw their future.Regardless of the reason, if this is you, or if it’s your company’s strategy, here are 3 things you really say when you move everything to the public cloud.“We don’t need a workload placement strategy.”Public clouds have amazing capabilities and you should take advantage of them. However, with an all-in public cloud approach, you are guaranteeing that no other environment is better for a particular workload. Governance, risk management, and compliance analysis may suggest that running an application on-premises is optimal. Maybe service quality can be improved with infrastructure closer to home. With an all-in public cloud approach, you don’t get to make those assessments. You don’t need a workload placement strategy because nothing is run on-premises.“It’s actually better to put all our eggs in one basket, because we get more out of it.”It’s true that it’s much easier to learn one technology and deal with one vendor. You’re able to go deep and take advantage of a lot of features. But, it’s rarely advised to give anything or anyone too much power or control. No one wants to be vulnerable to a supplier driving up prices. The tech industry has largely moved away from proprietary technology as customers try to avoid lock-in. With an all-in public cloud approach, you put all your eggs in one basket. To get the most out of a move to the public cloud, you select a primary public cloud vendor and use as many of their key services as possible. These key services are proprietary and the cost to switch to another public cloud or back on premises is high.“Deploying compute or having data repositories at the edge won’t be necessary.”The use cases for the edge are just now coming into focus for business. IoT and 5G are driving much of this. Some experts predict that edge intelligence will be so massive that it will usher in the end of cloud computing. Who knows? What’s clear is that the edge is still a little fuzzy for businesses to predict exactly how it will affect them. Edge deployments of compute and data repositories will make the most sense in many cases. For instance, sending huge amounts of data to the cloud for processing may take too long. Instead, data is collected and analyzed locally, in real-time, and only the resultant data is sent to the cloud. With an all-in public cloud approach, all use cases at the edge aggregate data and move it to the cloud for processing and analysis.The businesses who choose to run a hybrid infrastructure think of their data center as an investment, not a cost. They maximize their placement options for each workload without sacrificing flexibility, agility, or scalability. In many cases, they actually gain from running the workload on-premises compared to the public cloud.Maybe it’s time to rethink your journey to 100% public cloud. Maybe now is the time to change course from feeling burdened by a hybrid infrastructure model to being empowered by it. IDC considers the hybrid approach to be the most pragmatic and effective in the short and long terms.[1]Dell Technologies can help you navigate how to do hybrid well. Start by downloading and reading the ebook, Developing an Effective Workload Placement Strategy. It’s a guide to help you choose where to run your workloads – in the public cloud or on-premises.[1] Source: Workload Placement Separates the Winners from the Losers in IT, an IDC White Paper Sponsored by Dell EMC, 2019.last_img read more


U.S. announces restoration of relations with Palestinians

first_imgUNITED NATIONS (AP) — U.S. President Joe Biden’s administration is announcing a restoration of relations with the Palestinians and a renewal of aid to Palestinian refugees. The announcement by acting U.S. ambassador Richard Mills is a reversal of the Trump administration’s cutoff of aid to the U.N. agency for Palestinian refugees. Mills told the U.N. Security Council this reengagement with the Palestinians is key to the Biden administration’s support for a two-state solution to the decades-old conflict agreed to by Israelis and Palestinians. He said Biden hopes to start working slowly to build confidence on both sides toward Israeli-Palestinian peace.last_img


Kansas governor: Medical pot should fund Medicaid expansion

first_imgOVERLAND PARK, Kan. (AP) — Democratic Gov. Laura Kelly is proposing that Kansas legalize marijuana for medical use to generate revenues that would finance an expansion of the state’s Medicaid health coverage for the needy. Kelly announced her proposal Monday. Kelly has made expanding Medicaid for as many as 165,000 additional Kansas residents a top priority since becoming governor two years ago, but top Republicans in the GOP-controlled Legislature have prevented its passage. Kelly also previously said she’d sign a medical marijuana bill but she hadn’t actively pushed the idea. She is wedding two ideas that are likely to face strong opposition among Republican legislative leaders and many rank-and-file GOP lawmakers.last_img