mastodon.world is one of the many independent Mastodon servers you can use to participate in the fediverse.
Generic Mastodon server for anyone to use.

Server stats:

11K
active users

#compression

7 posts7 participants0 posts today

🚀 Compute Bigger with Cat2Cloud Compression! 🗜️

In this third video, we explore lazy expressions 😴—a compression-native tool to optimize operations ➕✖️➗ on your data using the Cat2Cloud web client. 🌐

💡 With lazy expressions, you can decompress and compute data only when needed, saving time and resources! ⏱️

👉 Try it out here: cat2.cloud/demo

🔗 Learn more at ironarray.io/cat2cloud 👀
#compression #datascience #ironArray #data

Missed PyData Global 2024? No worries! You can now catch with our recorded session on YouTube. 🎥✨

In my tutorial, I covered:

🧮 The basics of an NDArray object in Blosc2
⚡ How to leverage lazy expressions for efficient computation
🛠️ Efficiently computing UDFs within the Blosc2 engine
🌍 Accessing your data from the network: a gentle intro to Caterva2

🎬 Watch the video here: youtube.com/watch?v=aR-i_a3nGx

Don't miss out—learn, explore, and level up your data skills! 🚀

Excited to announce the release of the second cat2cloud introductory video! 🥳
Our software optimises file transfer ⚡ and access for server-hosted data 📅 . cat2cloud's compression-first framework enables users to minimise transfer times and storage requirements 🗜️.

In this video, you can see how easy and quick it is to manage file storage using the ubiquitous jupyter notebook format 🐍 !
Find out more (and see the first video) at ironarray.io/cat2cloud!
#API #datascience #compression #jupyter

This is Internet Gold.

> "... it is important to note that the compression algorithm used by lzip only discards the unimportant data. And if it was unimportant before, what makes it so important now? Huh? In fact, many users may find that compressing their entire file system and then restoring it will be a good way to learn what is truly important."

web.archive.org/web/2001060804

web.archive.orgLzip lossy compression

Brand new PEP by @emmatyping to add Zstandard to the standard library:
peps.python.org/pep-0784/

Will it make it in to 3.14 before the feature freeze on 2025-05-06? It'll be close but it's possible!

The PEP also suggests namespacing the other compression libraries lzma, bz2 and zlib, with a 10-year deprecation for the old names.

Join the discussion to give your support, suggestions or feedback:

discuss.python.org/t/pep-784-a

Python PEPs
Python Enhancement Proposals (PEPs)PEP 784 – Adding Zstandard to the standard library | peps.python.orgZstandard is a widely adopted, mature, and highly efficient compression standard. This PEP proposes adding a new module to the Python standard library containing a Python wrapper around Meta’s zstd library, the default implementation. Additionally, to a...
#PEP#PEP784#zstd