A Google search for "z/OS big data" comes up with some interesting links to avoid moving the data for off-platform processing.
I know this sounds like a sales pitch, but IBM offers multiple methods of running non-Z software inside a Z box; zCX, zLinux flavors and zBX blade (hardware) extensions with non-Z processors. I'm not sure on the details of how far IBM got with data sharing between these and your z/OS. But even if there is no sharing, you'll have the benefit of improved I/O performance if the data stays in the box. Your local IBM rep can work with you to fill in the details and see if this is a good fit for you.
Regards,
Onno
Onno Van den Troost
z/OS specialist for Developer for z/OS
IBM z Systems
[+1] (720) 342-6760
onno@...
IBM
----- Original message -----
From: "John Davies" <daviesja@...>
Sent by: zowe-dev@...
To: zowe-dev@...
Cc:
Subject: [EXTERNAL] Re: [zowe-dev] Information on data movement out of z/OS using Zowe and other platforms
Date: Fri, Jan 22, 2021 8:26 AM
Hello John,
The first question I'd ask is "Do you really have to move the data off the mainframe?" In-situ processing of high data volumes is a fruitful research area, particularly in high-performance computing. With Zowe's REST API capabilities, you might want to consider running the application that consumes the mainframe data ... on the mainframe itself. Applications written for Linux and Node.js will already run on z/OS, so it's something I'd throw into the mix.
Also, in-situ is more future-proof, since I/O bandwidth trends generally lag behind processor power.
Regards,
John A Davies, z/OS IBM Systems | zSystems Software, Hursley, UK. Tel 37245623, +44 (0)1962 815623, Mobile +44(0)7867 190094. daviesja@... @john_a_davies (Slack)
From: "John Mertic" <jmertic@...>
To: "Bendre, Upen" <UBendre@...>, zowe-dev@..., "omp-technical@... Calendar" <omp-technical@...>
Cc: "info@..." <info@...>
Date: 22/01/2021 13:01
Subject: [EXTERNAL] Re: [zowe-dev] Information on data movement out of z/OS using Zowe and other platforms
Sent by: zowe-dev@...
Hi Bendre, I'm not familiar with projects in the area you are...
| This Message Is From an External Sender | | This message came from outside your organization. |
|
|
|
Hi Bendre,
I'm not familiar with projects in the area you are looking for, but I've CCed @zowe-dev@... who is a great group of experts that could help provide greater insight, along with @omp-technical@... for the broader community.
Thank you,
John Mertic
Director of Program Management - Linux Foundation
ASWF, LF AI and Data, LF Energy and Open Mainframe Project
jmertic@...
+1 234-738-4571
Schedule a meeting with me at https://meetings.hubspot.com/jmertic
On Fri, Jan 22, 2021 at 1:23 AM Bendre, Upen <UBendre@...> wrote:
Hi,
Are there any projects built to support non-TCP based bulk data transfer of flat files, PDS, VSAM, and DB2 change logs, out of the mainframe?
We are already looking to adopt Zowe for lot of our z/OS work, but we also have high performance reporting and analytics requirements for which we need to get data out of the mainframe.
Thanks,
Upen Bendre
FSG Architecture team
SS&C Technologies
Please consider the environment before printing this email and any attachments.
This e-mail and any attachments are intended only for the individual or company to which it is addressed and may contain information which is privileged, confidential and prohibited from disclosure or unauthorized use under applicable law. If you are not the intended recipient of this e-mail, you are hereby notified that any use, dissemination, or copying of this e-mail or the information contained in this e-mail is strictly prohibited by the sender. If you have received this transmission in error, please return the material received to the sender and delete all copies from your system.
Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 741598.
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
|
