You assume that I can access PIP on a big data cluster in a financial institution ;) Even updating packages there requires me to ask for a custom image. I’m a data analyst so I just transform and extract what I can in a way that reduces size of the output and do cool stuff on my machine that has Python 3.11 and access to validated PyPI mirror. ETL that happens entirely on the cluster needs to be so optimised that I don’t need anything fancy thankfully.
Mastodon: @misk@pol.social
Piefed: @misk@piefed.social
Opinions exclusively of my own and of voices in my head.
Autism, communism, arthitism, cannabism.
- 73 Posts
- 10 Comments
Once that happens it’ll be just couple of years until trickles down to corpo I work at :(
We got Python 3.10 in our Hadoop/Spark setup recently. I’m really enjoying those improved debug messages, man.
misk@sopuli.xyzOPto
Hardware@lemmy.ml•Ultra Accelerator Link is an open-standard interconnect for AI accelerators being developed by AMD, Broadcom, Intel, Google, Microsoft, others
3·1 year agoGoogle and Microsoft are important here. They both manufacture AI chips and sell compute via Cloud and Azure. I’m surprised Amazon is not onboard but this might be enough.
misk@sopuli.xyzto
Hardware@lemmy.ml•Intel's "Skymont" E-core Posts a Double-digit IPC Gain Over "Crestmont": Leaked Presentation
3·1 year agoWith the way process node naming schemes went completly meaningless while still being expressed in nanometers I expected double digit to mean 0.9%.
misk@sopuli.xyzOPto
Hardware@lemmy.ml•Putin orders development of homegrown Steam Deck-like gaming machines — 100% self-sufficiency goal apparently applies to gaming, too
301·2 years agoNo catch-up needed, got first prototypes already!

misk@sopuli.xyzOPto
Hardware@lemmy.ml•Ex-Samsung employees arrested for selling memory secrets to China’s CXMT fab — prosecutors say the theft is worth $1.8 billion in damages
351·2 years agoYou might have had a point if the guy released this to the public and not to a direct competitor.
misk@sopuli.xyzto
Free and Open Source Software@beehaw.org•TC on open source evangelists
84·2 years agoGuy wanted to vent about smart thermostats, explicitly said he doesn’t need advice and got bajillion responses with advice, mostly from FOSS folks who couldn’t contain themselves. I’d be annoyed too.
misk@sopuli.xyzto
Free and Open Source Software@beehaw.org•Alternative Social Media Platforms
5·2 years agoWhat do you use Facebook for?
In terms of replacements with somewhat close feature sets there’s Friendica. It’s ActivityPub based like Lemmy and Mastodon. But ultimately it’s usually about people and groups you interact with and they probably won’t be there.
misk@sopuli.xyzOPto
Hardware@lemmy.ml•Samsung expected to report 80% profit plunge as losses mount at chip business
4·2 years agoYeah, expressing profit change percentage wise is dumb and prone to jumps if business doesn’t have high margins.
Semiconductor business part is more important here and why I posted this to c/hardware.







I thought I’d be using Polars more but in the end, professionally, when I have to process large amounts of data I won’t be doing that on my computer but on a Hadoop cluster via PySpark which also has a very non-pythonic syntax. For smaller stuff Pandas is just more convenient.