This was some quick research on something that I found interesting. Was trying to solve a problem, but this might be overkill. It is intersting though!
Duplicate code can be hard to find, especially in a large project. But PMD’s Copy/Paste Detector (CPD) can find it for …
Do a reasonable diff on a TeamSite XML file
I recently needed to find out if there were any differences in a merge TeamSite XML file and what I originally had. We had lots of tickets go into the branch this was in and someone else did the merge, so …
Get a rational difference between two dictionaries
Dictdiffer is a helper module that helps you to diff and patch dictionaries.
from dictdiffer import diff, patch, swap, revert
first = {
"title": "hello",
"fork_count": 20,
"stargazers": ["/users/20", "/users/30"],
"settings": {
"assignees": [100, 101, 201],
}
}
second = {
"title": "hellooo",
"fork_count": 20,
"stargazers": ["/users …make getting xml into a Python dict easy
I needed to compare 2 xml files to see where they differed and it's not so easy. I think that this module will help.
xmltodict is a Python module that makes working with XML feel like you are working with JSON …
This was taken from my RoundToit project notes, where I have put several things that I find interesting. I just realized that I should put it in my tips as well.
Looking at abstract classes article (abc- Abstract Base Classes) gave me some ideas on how to handle the registering …
As the Real Python article [Data Classes in Python 3.7+ (Guide)][3] says:
One new and exciting feature coming in Python 3.7 is the data class. A data class is a class typically containing mainly data, although there aren’t really any restrictions. It is created using the …
convert YAML to a different format
This was useful, as it gave me a way to easily convert my YAML file into a consumable Python dictionary for testing. That way, I didn't have to do it all by hand.
This site, Online YAML Parser, is quite useful for that. Will …
The article Python Multiprocessing For Beginners goes through how to use multiprocessing in Python. As the article says:
This article is going to teach you, How to apply python multiprocessing for your long-running functions
I'll need to go through it at some point, as it looks like it could be …
Python Timer Functions: Three Ways to Monitor Your Code
The article Python Timer Functions: Three Ways to Monitor Your Code looks like it's a pretty good tutorial that leaves you with a usable timer for your code. You can use it as:
All useful …
Nice article How to manage Python projects with Pipenv on setting up a new project with pipenv. This article doesn't opine on the correct or best practice for a project. You can assume a blank directory to whatever you normally do with a project. It's up to you.
I ran across a situation where I'd like to create a comment in a Markdown document, but didn't know how. So, I looked it up. Here is what I found:
Comments in Markdown - this gives several that could be used, so ...
Using the answer by Magnus, I see these:
[comment …It takes git status lines and converts it to a string with no line feeds, and then adds it to the clipboard for easy copying.
This has been a issue with using git when you don't want to have to do a git add . command. Grid …
marshmallow is an ORM/ODM/framework-agnostic library for converting complex datatypes, such as objects, to and from native Python datatypes.
In short, marshmallow schemas can be used to:
Abstract Classes in Python - (on Medium, so ... I have the PDF version in my documents directory as well) - it doesn't say a lot, but it does give slightly more than the code below. Slightly more ...
from abc import ABC, abstractmethod
class Animal(ABC):
@abstractmethod
def move(self):
print('Animal moves …In Data Visualization, Dashboard is the great Graphical User Interfaces that helps you to display the information in a highly interactive and informative way. It helps to visualize the key indicators and trends of the data.
Create Interactive Dashboards with Streamlit and Python
Streamlit
Streamlit is gaining popularity in Machine …
This would be something useful for me when using PyCharm and pytest. I don't have (or don't know if it's possible) to have the IDE run all the tests in a file, so ... I want a way to tag all the functions to run in my executeAllTests() function that I …
How to Manage Virtual Environments with PyEnv
Managing virtual environments with pyenv
Good article. Has some good descriptions but here are the highlights that I will end up using.
#### list installed Python versions
pyenv install --list
#### install one
pyenv install 3.8.0
#### to activate and start using Python 3 …How to use your installed package to test against
This is a description of what I had read somewhere, but was having a hard time finding it. I just found one of the source that I was thinking about, though what I list below seems to follow in the same …
Best Practices and Hints on What to Do
There are lots on interesting tips and tricks, apparently, that you should be doing, if you're going to do things right! I've never packaged a Python module, so this is fascinating to me.
Here are the links I found:
Various ways to create a PDF from Markdown
The following sections assume that you want to use a script (or within a script) to do the conversion. There are probably other tools out there that can be used at the command-line for doing that as well.
So, if you need …
Here are some resources that I used:
Intro to Reactive Programming in Python
Here are several links (two are related - github and docs):
Here is a little research that I did on finding how others did a plugin system.
This article - Designing a JavaScript Plugin System goes through and explains a simple plugin architecture that could be used in any system -- JavaScript, Python, or whatever.
Plugins are a common feature of libraries and …
How to "print" to a string in rich
On an issue that I submitted to the repo, asking if there was a similar interface in rich as what textwrap gives (specifically, the subsequent_indent value), I was told about tables and table.grids, which worked, but I still would like to …
Simple command line tool for scheduling scripts
hickory - schedule Python scripts - this looks interesting. I think it might have some good uses.
One use, that I'm using for exporting my journals, but am not happy with, could be a good candidate for this tool. It might be doing much the …
Typer, build great CLIs.
Easy to code. Based on Python type hints.
Typer, build great CLIs. Easy to code. Based on Python type hints. -- docs
Another interesting way to build a script with great command-line help. Requires Python 3.6+ and relies on Click. Looks interesting though.
Difference from cmd …
Work uses Confluence, which has a horrible markup syntax. And, since I try to use Markdown all the time, it would be very convenient if I had some way to convert my document to Confluence.
Markdown to Confluence Converter potential sites/links
This is how to upgrade the installed version of jrnl. You can see the version that is installed by:
jrnl -v
Check at pip - jrnl to see what the latest version is and compare it to what you have installed. If what is available is later (i.e. great number …
Here is a nice article How to pretty print XML from the command line? that shows a lot of ways to do that, but I really like the one with Python, as it totally solves a problem I was having.
cat SomeXmlDataFileToPrint.xml | python -c 'import sys;import xml.dom …Some interesting links to look at and when you need them, you need them:
cmd — Line-oriented Command Processors
Here is a link that explains some stuff that I apparently missed earlier, but it could also be that, since this is for Python 3, I could have skipped it, as, at the time, I needed to support Python 2 as well.
Anyway, the cmd — Line-oriented …
This is something that has intrigued me for awhile and didn't have a good answer to it, until today.
It seems that you can run the following command:
pip list --outdated
in your Python project command-line, and it will show you interesting information.
I did this for my cmd-clui project …
Terminal Markdown Viewer (mdv)
I was having some issue with several of the other markdown terminal viewers that I typically use (mdless, mdp, rich-framework, and the like) as they don't really do tables (like rich) and mdless was ok, but ... I wanted more. I'm not sure that …
A Python 3 implementation for client-side web programming
Here is a link to Brython. I do say it looks interesting.
Brython is designed to replace Javascript as the scripting language for the Web. As such, it is a Python 3 implementation (you can take it for a test drive through …
Three basic questions for this:
The requirements.txt file is used for specifying what Python packages are required …
In the Tools/scripts directory of Python - lots of goodness there. Don't forget!
If you can find your Python directory, there are lots of good tools there to use, if you want.
My favorite (right now) is the diff.py that does a really good job of showing differences, down …
Pretty useful to have and know and I always find something, use it, and then forget where I used it (and how) but only remember that I did it. Sigh.
Here are several useful links:
How do I make python programs behave like proper unix tools? - I like ixtmixllix's approach …
Sigh. This has tripped me up several times and made me think something was wrong with my setup. Good to know. IDEs Support - can't debug when using cmd readline and command completion.
From one of the posters, "readline works only in a real terminal. The output console that you get …
I was getting an error with Python 2.7 after coming in this morning and running a script.
Here is the error:
ValueError: unsupported hash type sha512
Along with a LOT of console output. This was what got repeated over and over.
Here is the fix Work around with Open …
It seems that there are a couple of different package managers in the Python world that I didn't know about -- pipenv and poetry. Here is an article that explains some about both Pipenv and Poetry Package Managers. Good reading and some pluses and minuses. This article does give some advice …
At the command prompt, run this command: pip freeze to get a list that can be put into a text file (need to figure out what to call it and how to use it) that is like a freeze list in JavaScript. You can also use pip list for a …
It seems that you have to put the following in your (at the end) .bash_profile or .szhrc:
eval "$(pyenv init -)"
A good source for this was: pyenv don't switch between python versions on macos #1446. Also, there is some good information on Catalina, where Apple switched to zsh as the …
I keep getting into a chicken/egg loop with trying to kick off a routine (whether it's a coroutine or a popen process or whatever) where I'm deadlocked because I need the process to return so I can start the process that will let it do the work!
Yeesh!
Anyway …
I need this for finally finishing up the test_changed.py script and making it work the way I want it to.
Here is the url: Python subprocess. Has some great examples.
This almost always messes me up in some way.
The important part is that you need to have the existence of a __init__.py file to tell Python 2.7 that it should treat the directory as a package. Then you can import from it.
Sigh.
I got that from …
Both are quite handy and I did NOT realize that they existed. Just import textwrap, give a constraint, and away you go. Quite nice. Need to use this in several scripts.
Found a nice implementation that works well at How to get Linux console window width in Python by Harco …
Found a good way to do print in both Python 2 and 3. I've hit this a couple of times now, so it would be good to remember it.
Here it is: print to stderr