You assume that I can access PIP on a big data cluster in a financial institution ;) Even updating packages there requires me to ask for a custom image. I’m a data analyst so I just transform and extract what I can in a way that reduces size of the output and do cool stuff on my machine that has Python 3.11 and access to validated PyPI mirror. ETL that happens entirely on the cluster needs to be so optimised that I don’t need anything fancy thankfully.
Mastodon: @misk@pol.social
Piefed: @misk@piefed.social
Opinions exclusively of my own and of voices in my head.
Autism, communism, arthitism, cannabism.
- 73 Posts
- 10 Comments
Once that happens it’ll be just couple of years until trickles down to corpo I work at :(
We got Python 3.10 in our Hadoop/Spark setup recently. I’m really enjoying those improved debug messages, man.
misk@sopuli.xyzOPto Hardware@lemmy.ml•Ultra Accelerator Link is an open-standard interconnect for AI accelerators being developed by AMD, Broadcom, Intel, Google, Microsoft, others3·1 year agoGoogle and Microsoft are important here. They both manufacture AI chips and sell compute via Cloud and Azure. I’m surprised Amazon is not onboard but this might be enough.
misk@sopuli.xyzto Hardware@lemmy.ml•Intel's "Skymont" E-core Posts a Double-digit IPC Gain Over "Crestmont": Leaked Presentation3·1 year agoWith the way process node naming schemes went completly meaningless while still being expressed in nanometers I expected double digit to mean 0.9%.
misk@sopuli.xyzOPto Hardware@lemmy.ml•Putin orders development of homegrown Steam Deck-like gaming machines — 100% self-sufficiency goal apparently applies to gaming, too301·1 year agoNo catch-up needed, got first prototypes already!
misk@sopuli.xyzOPto Hardware@lemmy.ml•Ex-Samsung employees arrested for selling memory secrets to China’s CXMT fab — prosecutors say the theft is worth $1.8 billion in damages351·2 years agoYou might have had a point if the guy released this to the public and not to a direct competitor.
misk@sopuli.xyzBanned from communityto Free and Open Source Software@beehaw.org•TC on open source evangelists84·2 years agoGuy wanted to vent about smart thermostats, explicitly said he doesn’t need advice and got bajillion responses with advice, mostly from FOSS folks who couldn’t contain themselves. I’d be annoyed too.
misk@sopuli.xyzBanned from communityto Free and Open Source Software@beehaw.org•Alternative Social Media Platforms5·2 years agoWhat do you use Facebook for?
In terms of replacements with somewhat close feature sets there’s Friendica. It’s ActivityPub based like Lemmy and Mastodon. But ultimately it’s usually about people and groups you interact with and they probably won’t be there.
misk@sopuli.xyzOPto Hardware@lemmy.ml•Samsung expected to report 80% profit plunge as losses mount at chip business4·2 years agoYeah, expressing profit change percentage wise is dumb and prone to jumps if business doesn’t have high margins.
Semiconductor business part is more important here and why I posted this to c/hardware.
I thought I’d be using Polars more but in the end, professionally, when I have to process large amounts of data I won’t be doing that on my computer but on a Hadoop cluster via PySpark which also has a very non-pythonic syntax. For smaller stuff Pandas is just more convenient.