Interesting tool. Haven't had a need for it yet, but I might. You never know.
Anyway, here is the blurb from their site:
q is a command line tool that allows direct execution of SQL-like queries on CSVs/TSVs (and any other tabular text files).
q …
several snippets of useful jq knowledge
Here are some links that helped me to figure out how to take multiple JSON files (that I am going to want to generate from jrnl) and combine them. Because of that, I also needed to make sure that I could remove duplicate (time …
This is something that I toy with at times and then usually drop to the floor, as I really need to get something done, rather than try a bunch of different options.
It is something that I'd like to figure out for me. I have it worked out for Python …
Getting Fossil and ChiselApp repos working
For whatever reason, I can’t seem to log into chiselapp with the password that I chose (or one that Apple chooses for me). I have had to say “Forgot my password” and have them send an email (with token) to my email above …
I recently needed to do this, so ...
Change your remote to SSH from HTTPS or reverse
This article has both Changing a remote's URL
Both are pretty much the same …
I started getting this with my Apple Smart Keyboard, for my 10.5 iPad Pro recently and it's starting to annoy me, so ...
What to do when you get this error
How to Fix When Your iPad’s Smart Keyboard is Not Working.
Several good ideas here.
Another article that …
Gradle Wrapper
The recommended way to execute any Gradle build is with the help of the Gradle Wrapper (in short just “Wrapper”). The Wrapper is a script that invokes a declared version of Gradle, downloading it beforehand if necessary. As a result, developers can get up and running with a …
jEnv - Manage your Java Environment
jEnv is a command line tool to help you forget how to set the JAVA_HOME environment variable
jEnv is here to help! It seems a lot like most of the other managers (pyenv, renv, nvm, etc.) and could be pretty useful. Using it for Grid …
Get a rational difference between two dictionaries
Dictdiffer is a helper module that helps you to diff and patch dictionaries.
from dictdiffer import diff, patch, swap, revert
first = {
"title": "hello",
"fork_count": 20,
"stargazers": ["/users/20", "/users/30"],
"settings": {
"assignees": [100, 101, 201],
}
}
second = {
"title": "hellooo",
"fork_count": 20,
"stargazers": ["/users …make getting xml into a Python dict easy
I needed to compare 2 xml files to see where they differed and it's not so easy. I think that this module will help.
xmltodict is a Python module that makes working with XML feel like you are working with JSON …
This was taken from my RoundToit project notes, where I have put several things that I find interesting. I just realized that I should put it in my tips as well.
Looking at abstract classes article (abc- Abstract Base Classes) gave me some ideas on how to handle the registering …
how to use AWK to print/filter data
I needed to just print out some columns in a file to see if I was missing something or not, so ... AWK to the rescue.
Some useful urls:
As the Real Python article [Data Classes in Python 3.7+ (Guide)][3] says:
One new and exciting feature coming in Python 3.7 is the data class. A data class is a class typically containing mainly data, although there aren’t really any restrictions. It is created using the …
I need to remove the first two columns in a CSV file that was generated from Mockaroo, but I had to create a date and time field in it as well, to get the correct format for a date field(s), as it didn't let me completely generate what I …
The article Python Multiprocessing For Beginners goes through how to use multiprocessing in Python. As the article says:
This article is going to teach you, How to apply python multiprocessing for your long-running functions
I'll need to go through it at some point, as it looks like it could be …
Some really good tips and things to think about in general. Here is a general overview of the article. Read it for the full affect!
From the article:
Watch out for functions being used as callbacks, and objects being used as options, unless they were designed for those purposes. Unfortunately …
Here is a really good overview from Lisa Seeman that covers how to achieve better accessibility for your website.
WAI ARIA in 5 steps by Lisa Seeman, who seems to be an expert on accessibility stuff.
She has other articles and videos out there.
This video was a good overview …
Step by step tutorial
The article A Step-by-Step Tutorial for Your First Angular JS App seems to cover a wide range of interesting things in Angular.
I've not gone through it all yet, but it seems better than a lot I've seen up to this point, so ...
Mermaid - Mermaid is a Diagramming tool for everyone.
It does flowcharts, class diagrams, sequence, state, entity, gantt, and others that seem to be pretty useful.
It seems that there are some VSCode plugins that support this. Markdown Preview Mermain Support is one such. There are others for creating PDF files …
How to insert current date time in vscode?
User Jakub Synowiec created a VSCode extension that does this. Here is a link (in stackoverflow) for it [VSCode extension - insert date string](https://stackoverflow.com/questions/38780057/how-to-insert-current-date-time-in-vscode#:~:text=Press%20%E2%87%A7%20%2B%20%E2%8C%98%20 …
Python Timer Functions: Three Ways to Monitor Your Code
The article Python Timer Functions: Three Ways to Monitor Your Code looks like it's a pretty good tutorial that leaves you with a usable timer for your code. You can use it as:
All useful …
Nice article How to manage Python projects with Pipenv on setting up a new project with pipenv. This article doesn't opine on the correct or best practice for a project. You can assume a blank directory to whatever you normally do with a project. It's up to you.
If there are multiple windows of Sublime Text up and I start a new jrnl entry, it switches it to the last in focus sublime text file.
While this works most of the time, now that I've started to use it more and have multiple windows open, it's not what …
I ran across a situation where I'd like to create a comment in a Markdown document, but didn't know how. So, I looked it up. Here is what I found:
Comments in Markdown - this gives several that could be used, so ...
Using the answer by Magnus, I see these:
[comment …How to have url that underlines a link, but goes nowhere when clicked on.
Just need a way to have a "link" that shows the underline (default) behavior of the browser, to show that there is a link, but when you click on it, it does …
Nice article at Better Dev blog. Has an interesting Minimal safe Bash script template with a nice template to start with.
Much like what I have but with some other features that I didn't think about or didn't need. It could be very useful. I might steal some of the …
What is the bash shortcut to change to the previous directory?
A nice description here of how this works. Can be used in git as well.
From man page for bash:
When a is used as the operand, this shall be equivalent to the command: cd "$OLDPWD" && pwd which changes …
In CSS, adjacent margins can sometimes overlap. This is known as “margin collapse”, and it has a reputation for being quite dastardly.
Rules of Margin Collapse - posted in one of the Slack channels by Ray Wedkins.
Seems like a good read (so far - haven't finished it yet, but wanted to …
marshmallow is an ORM/ODM/framework-agnostic library for converting complex datatypes, such as objects, to and from native Python datatypes.
In short, marshmallow schemas can be used to:
Some of the same stuff as other articles, but this has at least one tip that I don't remember reading that might be useful -- custom CSS styles for a console. Who knew?
Anyway, a nice summary and good article overall.
Has some nice descriptions on pseudo-elements that look interesting and might be usefule at some point.
How to export specific data from jrnl to jq md format
#### this needs to be run in cmd-grid to work as intended
md -v jqmdraw -contains "RWS-5760"
#### the actual jrnl command would need to be something like the following
#### with the assumption that you have the other files as well …how to write a find-exec loop that exits on failure
I was trying to figure this out for a command I needed to run in Grid, but, it's a useful pattern in general.
How to exit from find -exec if it fails on one of the files
The answer from …
Abstract Classes in Python - (on Medium, so ... I have the PDF version in my documents directory as well) - it doesn't say a lot, but it does give slightly more than the code below. Slightly more ...
from abc import ABC, abstractmethod
class Animal(ABC):
@abstractmethod
def move(self):
print('Animal moves …In Data Visualization, Dashboard is the great Graphical User Interfaces that helps you to display the information in a highly interactive and informative way. It helps to visualize the key indicators and trends of the data.
Create Interactive Dashboards with Streamlit and Python
Streamlit
Streamlit is gaining popularity in Machine …
This would be something useful for me when using PyCharm and pytest. I don't have (or don't know if it's possible) to have the IDE run all the tests in a file, so ... I want a way to tag all the functions to run in my executeAllTests() function that I …
A fossil SCM integration into Jetbrains IDEs
Here is the github repo fossil4idea and the Fossil Integration in the JetBrains Marketplace.
The plugin has not been maintained for over 5 years, so ... Not sure if it will work in the current versions, but it could serve as a great example …
How to Manage Virtual Environments with PyEnv
Managing virtual environments with pyenv
Good article. Has some good descriptions but here are the highlights that I will end up using.
#### list installed Python versions
pyenv install --list
#### install one
pyenv install 3.8.0
#### to activate and start using Python 3 …How to save ALL your iTerm settings
I had this set up once and then, of course, promptly forgot how I had done it. So, now that I've needed it again, I'll document how I got things working and how to do it again, if needed.
First, you need to …
How to use your installed package to test against
This is a description of what I had read somewhere, but was having a hard time finding it. I just found one of the source that I was thinking about, though what I list below seems to follow in the same …
Best Practices and Hints on What to Do
There are lots on interesting tips and tricks, apparently, that you should be doing, if you're going to do things right! I've never packaged a Python module, so this is fascinating to me.
Here are the links I found:
Various ways to create a PDF from Markdown
The following sections assume that you want to use a script (or within a script) to do the conversion. There are probably other tools out there that can be used at the command-line for doing that as well.
So, if you need …
Here are some resources that I used:
I was wondering how to read a YAML file in bash or if it was possible (without super-human effort) and pkuczynski - parse_yaml.sh script does it and seems to be fairly straight-forward.
I haven't tried it yet, but it looks fairly easy.
Intro to Reactive Programming in Python
Here are several links (two are related - github and docs):
Here is a little research that I did on finding how others did a plugin system.
This article - Designing a JavaScript Plugin System goes through and explains a simple plugin architecture that could be used in any system -- JavaScript, Python, or whatever.
Plugins are a common feature of libraries and …
How to "print" to a string in rich
On an issue that I submitted to the repo, asking if there was a similar interface in rich as what textwrap gives (specifically, the subsequent_indent value), I was told about tables and table.grids, which worked, but I still would like to …
Simple command line tool for scheduling scripts
hickory - schedule Python scripts - this looks interesting. I think it might have some good uses.
One use, that I'm using for exporting my journals, but am not happy with, could be a good candidate for this tool. It might be doing much the …
Client-side Authentication the the Right Way (Cookies vs. Local Storage)
Client-side Authentication the the Right Way (Cookies vs. Local Storage)
Trying to figure out a sameSite cookie issue, I ran across this article. I think it does a really good job of describing the whole process. I sort of knew …
Typer, build great CLIs.
Easy to code. Based on Python type hints.
Typer, build great CLIs. Easy to code. Based on Python type hints. -- docs
Another interesting way to build a script with great command-line help. Requires Python 3.6+ and relies on Click. Looks interesting though.
Difference from cmd …
Here is the osXDaily site get Lynx for Mac. I used brew as I think it's the easiest.
I installed it by brew install lynx and then ran it on their site: lynx osxdaily.com.
Very interesting. I think I could get used to it on some sites.
An interesting …
Found a couple of good links that have some decent information on Markdown (though which flavor is up for grabs):
This will get the destination of the soft-link (whether it's a file or directory) and return it.
Find only destination of symlink
Good answers in all, but had a problem with the first answer using readlink (by nikitautiu) as the version that macOS is using, doesn't have the same flags …
There are many times that I have no idea of where a command I use actually resides in the system. Sometimes I do, and what I'm calling is not the command that I know it should be, so ... How do you tell where the command that works from the command …
11 tips you must know if you choose Chrome as your development environment.
From the author:
But do you really understand Chrome DevTools? In fact, it provides many powerful but unknown functions, which can greatly improve the efficiency of our …
CLUI: Building a Graphical Command Line has a nice article on using the command-line for graphical programs. It goes into some good discussion on the command-line and GUI interfaces and how they differ and what each expects. It's very interesting if you've never thought about it before.
It was this …
Use Chrome DevTools Like a Senior Frontend Developer - 11 tips you must know if you choose Chrome as your development environment.
Good article. Saved it in my work-releated docs directory, just to make sure I have it (since it's Medium and I don't always have enough free articles to access …
Here is the json to text conversion, that was part of the view jrnl project, but I couldn't get working for some reason when I tried it.
Anyway, had some time today and decided that I should try it, as it would be very helpful to know how to do …
An interesting thought: jrnl as webpage. There is a React component as well. Not sure how useful this would be, but ...
Noted in my README.md in my cmd_clui repo.
This is how to upgrade the installed version of jrnl. You can see the version that is installed by:
jrnl -v
Check at pip - jrnl to see what the latest version is and compare it to what you have installed. If what is available is later (i.e. great number …
The link, How do I find all files containing specific text on Linux? shows how to use grep to accomplish this.
It also shows the typical find command that is recommended, which, like the poster, I didn't get to work for me either, so ...
The answer I used is by …
Even though bash doesn't technically allow you to return a value (even through it has a return statement), there are ways you can accomplish this in the Return a value in a bash script says how, but I like tamasgal's answer best:
function fun1(){
echo 34
}
function fun2(){
local …Here is a nice article How to pretty print XML from the command line? that shows a lot of ways to do that, but I really like the one with Python, as it totally solves a problem I was having.
cat SomeXmlDataFileToPrint.xml | python -c 'import sys;import xml.dom …Merge Ethernet connections on Mac to boost network speeds Pro tip
It explains how to chain multiple ethernet connections together. Sounds interesting and might be useful.
Did you know it’s possible to merge multiple Ethernet ports into one on a Mac? The feature is simple to set up and …
Some interesting links to look at and when you need them, you need them:
cmd — Line-oriented Command Processors
Here is a link that explains some stuff that I apparently missed earlier, but it could also be that, since this is for Python 3, I could have skipped it, as, at the time, I needed to support Python 2 as well.
Anyway, the cmd — Line-oriented …
This is something that has intrigued me for awhile and didn't have a good answer to it, until today.
It seems that you can run the following command:
pip list --outdated
in your Python project command-line, and it will show you interesting information.
I did this for my cmd-clui project …
Here is how you assign what comes back from an echo statement to a bash variable.
How to assign the result of echo to a variable in bash script
MY_CHOICE=`echo $1 | tr "[:lower:]" "[:upper:]"`
What I wanted to do was to set a variable in bash from a function. Not as easy as I would have hoped.
Returning values from bash functions
Here is the choice I used from the article:
The other way to return a value is to write your function so …
Found a couple places (took me a minute to figure out what they meant - sort of thick at times).
Here is the code:
#### https://linuxhint.com/bash_lowercase_uppercase_strings/
#### upper-case the passed in choice
#### - have to use for bash …Terminal Markdown Viewer (mdv)
I was having some issue with several of the other markdown terminal viewers that I typically use (mdless, mdp, rich-framework, and the like) as they don't really do tables (like rich) and mdless was ok, but ... I wanted more. I'm not sure that …
Timenow package
I'm constantly needing to insert the date/time into a Markdown document, and it would be nice to not have to do it manually all the time.
Found the package Timenow and installed it in SublimeText 3.
Here is my Default(OSX).sublime-keymap--User file (from …
A Python 3 implementation for client-side web programming
Here is a link to Brython. I do say it looks interesting.
Brython is designed to replace Javascript as the scripting language for the Web. As such, it is a Python 3 implementation (you can take it for a test drive through …
Slack is giving your weekends back with per-day notification scheduling
Allows you to set a schedule on when (weekdays) and a time range. Nice!
The article is a little vague on where you can find the Pause notifications menu item (probably because he is not using MacOs, but ...). Anyway, for …
Three basic questions for this:
The requirements.txt file is used for specifying what Python packages are required …
When modifying your domain's AMP/DNS - remember to unlock domain!
When trying to do something with your domain (change settings and the like), remember that you probably need to unlock your domain before you can actually save your new stuff.
I was trying to point my codejobler.com domain …
In the Tools/scripts directory of Python - lots of goodness there. Don't forget!
If you can find your Python directory, there are lots of good tools there to use, if you want.
My favorite (right now) is the diff.py that does a really good job of showing differences, down …
locate is a good alternative to using find
As noted in the finding the Tools/scripts subdirectory in stackoverflow:
This command
$ locate "Tools/scripts/diff.py"
will find the location of the file if it's installed. This depends on the database generated regularly by the updatedb command (this usually runs …
How to get directory listing with human readable file sizes
Usually, it doesn't matter too much, but it's nice to have the sizes shown rather than the bytes.
alias lh='ll -h'
Now, should have two decent directory listings: ll and lh.
This solved the very annoying problem with the docking station choosing the Dell monitor (usb-c interface) instead of the Thunderbolt-3 adapter (to my Thunderbolt 2 Display). In short, if it chooses anything but the Thunderbolt display first, it makes it so that the display will not work (oddly, all of …
BASH command output to the variable has great examples of how to do this. Basically, it boils down to something like this:
variable=$(command)
variable=$(command [opotion...] arg1 arg2 ...)
variable=$(/path/to/command)
You can also use the "`" as well, with all the caveats of using it in bash entails …
There are times, where I want to see what my setting is and others, I need to be able to set to what I want, after it's been reset for me.
I've noticed that for whatever reason, there are times where getting git from grid, resets my …
Pretty useful to have and know and I always find something, use it, and then forget where I used it (and how) but only remember that I did it. Sigh.
Here are several useful links:
How do I make python programs behave like proper unix tools? - I like ixtmixllix's approach …
So many interesting things to learn here.
I knew about aliases and use them all the time. I had forgotten how to undefine them though, so ...
Here is how to define one:
alias someaction="some sort of action or something here"
You use it like you'd expect. At …
Useful to put in your .bash_profile file to remove all of the churn that gets added to your PATH environment variable.
#### -------------------
#### remove any duplicates in PATH - w/o changing order
#### -- https://stackoverflow.com/questions/11650840/remove-redundant-paths-from-path-variable
#### -------------------
export PATH="$(echo "$PATH" | awk 'BEGIN{RS=":";}
{sub(sprintf("%c$",10),"");if(A[$0 …It seems that if you use a code block (doesn't seem to matter if it's a 'named' block or not (i.e. javascript, bash, etc)), but if you have:
```
---
something here
```
Then, it will mess your Markdown up pretty royally! You have to do something like the following:
```
--- (note blank …Sigh. This has tripped me up several times and made me think something was wrong with my setup. Good to know. IDEs Support - can't debug when using cmd readline and command completion.
From one of the posters, "readline works only in a real terminal. The output console that you get …
I was getting an error with Python 2.7 after coming in this morning and running a script.
Here is the error:
ValueError: unsupported hash type sha512
Along with a LOT of console output. This was what got repeated over and over.
Here is the fix Work around with Open …
At the command prompt, run this command: pip freeze to get a list that can be put into a text file (need to figure out what to call it and how to use it) that is like a freeze list in JavaScript. You can also use pip list for a …
It seems that you have to put the following in your (at the end) .bash_profile or .szhrc:
eval "$(pyenv init -)"
A good source for this was: pyenv don't switch between python versions on macos #1446. Also, there is some good information on Catalina, where Apple switched to zsh as the …
I don't always need this, but at times, it is quite useful - view files in zip.
One command I was unaware of and one I had forgotten: zipinfo Archive.zip and unzip -l Archive.zip. Both should do the trick.
Here is basically what you need to do:
git push -u origin [your_branch_name]
an example:
git push -u origin dev_WEB_2020.04_STK_RWS-17501-addMegaHoverForUnderlying
This gets it up to the remote.
Here are some sites that document how to do different things (since I always forget some of them):
All are good and some have things others don't.
Some of the features I tend to want to …
Here is a site that has a maybe marginally useful utility (I'll see after I try it for awhile). mdless: Better Markdown in Terminal.
It is basically only useful for a presentation and you have to learn a different format from Markdown to do what you want. It's not bad and I like it, but it adds another layer on top of your Markdown document. -> mdp <-.
From an opinion article today describing our current situation in the government, I found this.
Somewhere along the line, my .gitconfig file changed and set/reset the push default to something other than what it was.
[push]
default = matching
This is what it should be:
[push]
default = simple
The value it is set to, determines what git will do with the branches on your machine …
An interesting way to look at and fix a problem. Bash - when did I run that command?
I might try to use something like that for a different problem, but the solution might be just as valid.
It appears that due to Windows and Mac machines in the same repo can cause this.
A solution appears to be at ignore ^M in git - Ryan Lundy's answer was, to me, the best.
Run the following at the command-line:
git config --global core.whitespace cr-at-eol
If you don't want …
Found a cool way to do a script (by Sparhawk in StackExchange) so that if you use sudo more than once or if a command requires you to enter your password, you should only have to enter it once.
I've used it already in my TCServer_restart.sh script and it …
A nice site to play with how you can manage/configure your bash prompt. Bash Prompt Generator
Found some tips on dynamic bash script. I tried to do some stuff and my attempt is shown below. It didn't work for the situation that I …
I thought it had a great explanation of some things I hadn't thought of, and it was very complete. pushd and popd commands
A useful thing to remember when you want to go back to where you started to do something!
I need this for finally finishing up the test_changed.py script and making it work the way I want it to.
Here is the url: Python subprocess. Has some great examples.
This almost always messes me up in some way.
The important part is that you need to have the existence of a __init__.py file to tell Python 2.7 that it should treat the directory as a package. Then you can import from it.
Sigh.
I got that from …
Look at Vi and Vim -- there is a lot of good information here.
Vim isn't my favorite editor, but it is useful and on Mac and Linux, you end up needing to use it more than some people like. I don't mind except I don't remember the commands very well …
Both are quite handy and I did NOT realize that they existed. Just import textwrap, give a constraint, and away you go. Quite nice. Need to use this in several scripts.
Found a nice implementation that works well at How to get Linux console window width in Python by Harco …
Here is a shell function and alias to define a way to view your PATH environment variable (i.e. - one directory path per line). Don't need to too often, but when I do, it's quite useful:
nice_path() {
tr ':' '\n' <<< $PATH
}
alias nicepath=nice_path
I made it an alias as well …
In the Include Files in Bash article, it gives some good examples (i.e. one reason to do this is for data, so it doesn't clutter up your script -- not stated, but I would use it this way).
Basically, it amounts to the following:
#!/usr/bin/env bash
source other-file …This is a handy bash script to remove duplicate PATH directories but doesn't modify the order of the path already listed. Pretty cool idea.
Here is the url: remove duplicate dirs from PATH
Here is the code:
export PATH="$(echo "$PATH" | awk 'BEGIN{RS=":";}
{sub(sprintf("%c$",10),"");if(A …An interesting website with some interesting insights.
Hackery, Math, & Design has some cool graphics on the homepage that I think are pretty interesting.
He also has some interesting thoughts on his site as well, from the few things I looked at, one being TermKit that he worked on 9 years …
Found a good way to do print in both Python 2 and 3. I've hit this a couple of times now, so it would be good to remember it.
Here it is: print to stderr
This looks like a really cool library that I might want to start using -- rich. I'll have to take a look at it soon!
It seems that it is only for Python 3.6+, but for my stuff, that isn't a bad thing.