Med-Mastodon

0 posts0 participants0 posts today

dr 🛠️🛰️📡🎧:blobfoxcomputer:I've been working on a <a href="https://hachyderm.io/tags/space" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#space</a> <a href="https://hachyderm.io/tags/visualization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#visualization</a> tool for our operators. It basically needs to always know, and be ready to plot, where every single one of 60k+ objects is down to millidegree/meter/second resolution just in case the sensor suddenly slews thereMy own constraint is that it has to be 1) a single 2) <a href="https://hachyderm.io/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> executable because otherwise I'm not interestedEarlier this year, I found a great 30x faster technique for determining which <a href="https://hachyderm.io/tags/satellites" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#satellites</a> are above the horizon. (In fact, it's far more general than that, but that's all the help it gives me to this problem.)I also realized I could spawn a <a href="https://hachyderm.io/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> child to do lookahead on data and then pass a huge <a href="https://hachyderm.io/tags/numpy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#numpy</a> array to my graphing process. (Investigated ~9 different ways, chose the best)But there I was stuck. At any given moment, there are ~4500 space objects above the horizon (at our latitude). Putting 4500 points with little persistence trails and labels and then updating all that at 1Hz let alone the 10Hz I'd like was taking too long, even using the amazing <a href="https://hachyderm.io/tags/pyqtgraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#pyqtgraph</a>So there I was stuck. Until this week.

rk: it’s hyphen-minus actuallyThe LOCK# signal is like “stop trying to make fetch happen.”<a href="https://mastodon.well.com/tags/programming" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#programming</a> <a href="https://mastodon.well.com/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a>

vintage screwlisp account<a href="https://climatejustice.social/@kentpitman" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@kentpitman</a> <a href="https://nein.ftrv.se/@sigrid" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sigrid</a> <a href="https://appdot.net/@mdhughes" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@mdhughes</a> <a href="https://functional.cafe/@awkravchuk" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@awkravchuk</a> Featuring <a href="https://mastodon.sdf.org/tags/unix_surrealism" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#unix_surrealism</a> ! <a href="https://merveilles.town/@prahou" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@prahou</a> <a href="https://mastodon.sdf.org/@pkw" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@pkw</a> ncurses <a href="https://mastodon.sdf.org/tags/lisp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lisp</a> <a href="https://mastodon.sdf.org/tags/asdf" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#asdf</a> <a href="https://mastodon.sdf.org/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> <a href="https://codeberg.org/pkw/open-borders" rel="nofollow noopener noreferrer" target="_blank">https://codeberg.org/pkw/open-borders</a>telnet lambda.moo.mud.org 8888 co guest @join screwtape <a href="https://mastodon.sdf.org/tags/lambdaMOO" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lambdaMOO</a> !I think <a href="https://social.jlamothe.net/profile/me" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@me</a> bumped eir head on the resource limit in-MOO finally? Meet in paradise sushi!

Emilia Jarochowska 🇺🇦🌱Have you ever programmed a human computer? Having 30 people walking around the room to exchange information between RAM addresses and CPU registers, and human CPUs execute operations on the clock is a very special experience*.This week I learned more than in a ~year of self-study, thanks to the 16th Advanced Scientific Programming in <a href="https://circumstances.run/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Python</a> <a href="https://aspp.school" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://aspp.school</a> We covered version control, packaging, testing, debugging, computer architecture, some <a href="https://circumstances.run/tags/numpy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#numpy</a> and <a href="https://circumstances.run/tags/pandas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#pandas</a> -fu, programming patterns aka what goes into a class and what doesn't, big-O to understand the scaling of various operations and how to find the fastest one for the given data type and size, and an intro to <a href="https://circumstances.run/tags/multithreading" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multithreading</a> and <a href="https://circumstances.run/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> 🍭A personal highlight for me was pair programming. I never thought writing code in with a buddy would be so much fun, but I learned a lot from my buddies and now I don't want to go back to writing code alone 😅Very indebted to the teachers and organizers; <a href="https://aspp.school/wiki/faculty" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://aspp.school/wiki/faculty</a> if you ever meet one of those people, please buy them a drink for what they have done for a better code karma state in the universe*our human computer didn't manage to execute the simplest sorting algorithm and the CPUs started to sweat; we experienced what happens when the code is ambiguous and imprecise 😱🫨

Alex JimenezIntroduction to <a href="https://mas.to/tags/Multithreading" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Multithreading</a> and <a href="https://mas.to/tags/Multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Multiprocessing</a> in <a href="https://mas.to/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Python</a> <a href="https://www.kdnuggets.com/introduction-to-multithreading-and-multiprocessing-in-python" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.kdnuggets.com/introduction-to-multithreading-and-multiprocessing-in-python</a><a href="https://mas.to/tags/Coding" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Coding</a>

RyeAdventures in <a href="https://ioc.exchange/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> I need to explore <a href="https://ioc.exchange/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> the process I created took more than 4 min to run, that's okay but I I will be using this data frequently so I'm looking for feedback on how to either structure the problem better, OR more resources? 100% consumption for 4 min on my main machine isn't what I want to do. Tho the data set is big, all other tasks run very reasonably with most tasks completing in 20 or 30 seconds.

dr 🛠️🛰️📡🎧:blobfoxcomputer:Took a fun couple hours creating a function that does his slowest part as a service (not doing his work for him--we realized this needs to exist outside of his work) and then also making a parallelized helper for it.Yep, 10-15x speedup using 16 cores. I think the operational machines have 32 or more cores, so this is great. Gets our final runtimes down to <1s (easy case) and <10s (hard case). <a href="https://hachyderm.io/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> <a href="https://hachyderm.io/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> <a href="https://hachyderm.io/tags/threads" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#threads</a> <a href="https://hachyderm.io/tags/software" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#software</a> <a href="https://hachyderm.io/tags/space" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#space</a> <a href="https://hachyderm.io/tags/orbitalmechanics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#orbitalmechanics</a>

dr 🛠️🛰️📡🎧:blobfoxcomputer:<a href="https://hachyderm.io/@the_curiostech" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@the_curiostech</a> I don't have a particular go-to. My frequent <a href="https://hachyderm.io/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> use-case is embarassingly parallel so I use <a href="https://hachyderm.io/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> mp.Pool.map().No rpc, no queues or locks or anything. Just "please blast this code across 10000 items and give me the results".I find if I write "base code" any more complicated than that the bugs I encounter are too hard for my tiny brain.

Peter Kahn🏳️‍⚧️🇺🇦🇵🇸🏳️‍🌈Oh wow <a href="https://tech.lgbt/tags/pyhton" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#pyhton</a> threading lib is sooo nice. I used the <a href="https://tech.lgbt/tags/multiprocessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#multiprocessing</a> lib a while back and found it cumbersome. Parallelism in my existing Artifactory calls will be a snap with this one. I update metadata on docker manifests with quality gate data, deployment operator and deployment approver. When I did this we had less than related 20 images. We now have 60+ and it’s time to boost the efficiency a bit. This will be easy. I haven’t had to do much unit testing around threading so this should be fun

Recent searches

Search options

Administered by:

Server stats:

#multiprocessing