What python project(s) are you currently working on?
With r/python out for the next 48 hours, here’s a post to promote continuing discussion a language we all love. Python.
View original on sh.itjust.works
With r/python out for the next 48 hours, here’s a post to promote continuing discussion a language we all love. Python.
Switched jobs recently. So I'm building templates before I get bogged down. I took the opportunity to switch to poetry and pyproject.toml instead of setup.py which I'm liking. I got my file loader ETL template complete. Right now I'm trying to get a fastapi webbackend template. I'm used to nodejs & express for this and I'm finding fastapi is pretty similar. I got oauth2 working with the companies LDAP but right now I'm struggling to find good documentation for jwt with refresh tokens.
I'm currently working on two book downloaders, one for audiobooks and one for ebooks.
Wicked, I'm gonna try it out! Just now restoring my old nook
Lots and lots at work...
But my only real side project right now is a scheduler and supervisor... "If cron and supervisord had a super-powered love child".
I'm very close to releasing v1 so I'm not gonna jinx it by revealing too much, but it's already in production use by two companies, one of which is enterprise-level, using it to process MASSIVE data somewhere in the entertainment industry... and yes, it's gonna be FOSS, with MIT license.
It emphasizes a declarative approach to reproducing clusters of orchestrated job-runners on low-cost cloud infrastructure. Makes it easy to scale and even map-reduce.
Includes 3 interfaces: CLI (for everything), API (for most things), and UI (for most things).
It's gonna be sick heheh. I'll be sure to come back here once you can
pip installit.ah yes, i have been trying to configure my crons and supervisord the right way and its such a pain in the butt. I would be EXTREMELY interested in trying/using it out. Also if you need any help let me know : )
I've been working on a telegram bot that lets me talk to ChatGPT
That's cool, I've actually been working on a discord bot that also talks to ChatGPT.
I've never used telegram but it sounds similarly useful.
What's the cost for chatgpt's API? I'd love to make my own chatgpt bot
Very low if you're just using it yourself and if you're just chatting with it. You're charged per token (roughly a word). They just decreased the prices a bit as well. I haven't paid more than like $5 in a month, usually less than $2. If you use things like autogpt and whatnot that automate and repeatedly call chatgpt, you can use up a lot of tokens though.
A desktop music player. My goal is for it to work with all kinds of sources like youtube, spotify, and soundcloud.
Is it gonna whip the llama's ass?
TIL. Yes, it will be whipping the llama's ass.
Sweet. I'd be down to test it when it's nearing readiness.
Dang, I had an idea much like this but kept getting turned off by the GUI design and lost interest. I would be very interested in this if you're ever up for sharing it.
Gladly, It's a question of when not if. Sadly, I don't know when that is. End of 2023 is my current guesstimate.
I’m building a back-end for my website without a framework.
Out of interest, why are you avoiding using a framework? I use Django literally every day for web dev, so I'm curious as to what your site requirements are like.
I tried Django at the beginning, it is very nice and I will most likely use it if I need to build a professional website, I wanted to understand and learn better how it all works and for my personal not serious website it was a perfect opportunity, so I started messing around and testing without a framework. Coding my own back-end is very fun for me and I’m learning a ton this way. Currently I am making an authentication system where if a client is not authenticated, it will get redirected to a login page where a code is displayed and a user has to send that code to my server’s whatsapp. Once the server validates the matching code from whatsapp, it will authorise the client and redirect back to the original requested page. This system will be perfect for me and my friends to access my website!
Ah, cool, that makes good sense. Yeah, it'll be a good learning process, as Django does handle so many of those things basically like magic and you never really need to learn what's going on under the hood. Good luck!
Thanks!
Which language?
Python of course! I am using hypercorn ASGI server, it supports HTTPS/3.
Oh of course lol, I didn't even realize where I was. And right on, sounds like a fun experience. I haven't messed with async python too much myself but it seems like a powerful way to run a webserver
Yes! Coding it is a blast! I started it just to better understand how all the HTTP communications work and I love customising my own personalised back-end, implementing new features and improving. I’m so hooked I can’t even sleep at nights, thinking about it.
I've been making a simple 8-bit game with the pygamer board from adafruit/digikey and CircuitPython. It's incredible to be able to run python on microcontrollers and it's a really simple workflow, though customizing your environment can be a little difficult when working on a constrained platform.
I've been having fun making Discord bots that use ChatGPT to generate various things. Stuff like giving tarot readings, creating custom MtG cards and whatnot. Nothing too crazy, but it's been fun to play around with.
What wrapper are you using for your bot? I dabbled with discord.py for a while, but the slash-command drama sorta killed my motivation.
That's the one I use - I wasn't aware of any drama.
Well I suppose that's good then. It was effectively killing the project last I read about it.
I was thinking about using something like this to supplement an Information Desk at an in-person conference. In case the desk had to be left unstaffed. I'm not sure how well the target population would respond to the technology though.
I would be very hesitant about giving people any reason to believe the information given by a GPT algorithm is accurate, unfortunately. Even with the best prompting and few-shot-priming, a lot of what they say will be simply made up.
I'm doing a python introduction course, I've made a hangman game and caeser cypher builder so far. It's just started getting into dictionaries so it would probably have something to do with that
Dictionaries are awesome! There are also Collections.defaultDict that you need to import specifically, but lets you assign values before the keys exist. Quite handy.
I've been using scanpy in my biomedical engineering research! Basically allows me to analyze the RNA expressed in single cells and see things like what functional phenotype these cells can be, how they have developed, in addition to spatial information on their arrangement.
I've made a small python script to copy over blog posts I write from Obsidian to Hugo, and change the hyperlinks from the markdown format to the Hugo format.
I really love working on small projects in python, such a great language.
This is really cool! Do you have you code on github? How are you handling pictures? I noticed that the way obsidian and hugo do it are different (obsidian adds it in the same working folder while hugo has a specific folder to store images)
Would be really interesting to do something similar with Lemmy links so you stay within your own instance. Not sure if that is something that could be done server side or if it's front end development.
Throughout my IT career when it came to troubleshooting mail delivery problems I typically always started with this website over the years some of the servers stopped working for me which lead me to start looking to create something similar but with python (and potentially incorporate it pyscript). I've only gotten about 25% done and now always I don't seem to have as much time to wire in and continue working on it but eventually I'm hoping to get something like this going again and potentially host it for the world to use.
I write a lot of Python code for work. Mainly small utility scripts to link different APIs together, or trigger something to happen via API when a database table entry has certain columns with certain values.
Not terribly complex work, but it pays well and takes very little time.
How did you get into that? Are you freelance?
Nah, been at the company over a decade. Started as tech support, worked myself up to server/database admin, and slowly automated my work away :P
I am scheduled to present at Python Frederick in August. It is a Practical Business Python styled talk showing the utility of automating complex reporting with Jinja2 and docx templates. This annual report is a real world example using Jinja2.
I use it at work doing work stuff, but I've been meaning to dig into pygame to make stuff with my kids. I might already try a QT app for desktop, IDK.
I mostly use it at home for one off scripts, so nothing really complex enough to discuss.
An algorithmic trading platform. Let me know if anyone wants a link to the Github repo.
I'd be interested in the github repo. I don't even know where to start with algo trading. I know there were some specific subreddits dedicated to it, but understanding the best strategy would be cool. Would be interesting to dissect what you're doing.
Have you used it in a live environment?
Yes, I've used it live. I ended up coming to the conclusion that Binance was rigged and that they were forward trading me.
If you want to learn a bit about algo-trading, a good place to start is John Ehler's books. Caveat: You'll need to have a decent foundation of maths under your belt, or be prepared to learn it.
There are a few repo's that are more mature than mine. Jesse and SuperAlgos spring to mind. Also, peruse https://github.com/topics/trading-algorithms
I'm in the process of documenting mine, and cleaning up the code so that it's more generic and neat. It's at https://github.com/noenfugler/algo-weaver
Thanks I'll look into it.
While I love Python, it's not the easiest language to do high freq low latency work on as I imagine algotrading would demand.
How have you worked around this, if at all?
I can't find a way to word this that doesn't sound really aggressive, the question is in good faith!
Liberal use of libraries written in c (e.g. pandas, pytorch, numpy), some use of cython (not in the current version, but I have done so), and relying on time frames and strategies which have some tolerance for latency. If you trade five minutes after the start of a 1 day candle on the basis of where you expect it to be at close, it's not such a big problem.
It's a losing game to try and out-pace the big end of town.
I just made a PR to fix an issue with yt-dlp where Chrome now locks its Cookies file while running.
Learned about a thing called "Shadow Copies". Basically Windows allows you to sort-of snapshot files in a volume even while in use.
Currently working on the backend for an RSS news feed web app. It's been interesting building xml and html parsers to extract news article content.
Currently working on a massive cookiecutter template to scaffold into all kinds of python projects, including ML, API/backend work, GUIs, python SDKs and such. The fun part is actually about configuring all of the dependencies and make it as modular as possible, giving the choice between poetry and pdm for the dependency management, black and yapf for the formatting, pyflakes, ruff and pylama for the linting etc.
I'm rewriting a site of single-page tools from Flask to Django. I need user roles management as I plan to open the site up to customers/vendors. It's nothing fancy, mostly calling and processing other peoples' APIs. I'm not a SysAdmin at all, and the most basic AWS set up stuff is taking up way more of my time than I'd anticipated! lol.
One-man operation, so there's no DevOps to help or anything. I'm not even a dev, I just make tools to do what I need.
Said every developer
I develop things, but I'm not paid specifically to do it or trained in it, is what I mean. Plus I'm bad at it.
Imposter syndrome is too real, though.
I haven't decided if I'll actually go through with it, but as a learning experience, I've been thinking about making little rewrites of some command line utilities (and maybe some original ones if I get any ideas) that output NestedText, instead of normal unstructured text. NestedText looks like a really cool data format. It's basically exactly what I wished Yaml was, and the reference implementation is in Python so maybe it could be fun. Plus it'd give me a reason to try out the really cool looking Typer library.
not exactly working on (it's mostly complete), but I made an online level browser for I Wanna Maker game.
I have a few projects going on but my main python project right now is training a somatic mutation filtering model for tumor-normal cancer pairs.
Hello all. I am new to lemmyband to python. I am currently just learning and have an interest in AI so figured it would be nice to understand some of programming behind it. I also just have always wanted to learn but fear of it won out until now. I am just doing the intro stuff but hopefully I can contribute more to the conversation in the future. For now I learn!
Edit: I deleted my prior post as I thought I was in the wrong thread. Woops. Sorry about thT.
I need to work on refactoring a plugin I made for MusicBrainz Picard that lets you submit chosen tags (typically genres) to matching entities on the site.
For work I do a lot of ETL and data matching from multiple different sources (mostly text files extracted out of databases). St home built a library for the ebay api to pull significant others sales data so she can use it for taxes.
If you dont mind me asking, whats your job title?
Not programming related lol. I just use it a lot for analytics but could 100% do my job without it. Although things would take longer.
But it's: Senior Manager Wholesalers, Customer Data and Systems.
I run 3 separate groups.
Kudos to you for thinking out of the box and seeking solutions to making your job more efficient! I hope your employer knows about it and values this knowledge you have.
Ha thanks. Yes I hate doing repetitive tasks so I'll automate them.
Personal static site generator. My aim with it is to double click a file and have everything ready to publish
I do my research in python so I'm currently working on some ways to evaluate/measure generalization problems in machine learning for rotating machinary-based data (ball bearing faults atm)
Currently extracting data visualizations for Tournesol project (project aiming to evaluate youtube videos by the community, giving his data open (when user allows it))
I'm working in a personal project to create a Nitter scrapper now that twitter free api is very limited.
I made a script using flask to generate an Opening and a Closing report based on stuff i did through chatgpt, then if i like it i can send it to our slack channel with one click. I am a very introverted person and hate communicating lol.
On the main "script" i have lots of microservices, including an overview of my stocks (gain,price, and return in euros instead of dollars) and a location updater for people at work since again i hate talking to people and they can see what i am up to.