Tiddlywiki for organizing notes and research

post by eukaryote · 2019-09-01T18:44:57.742Z · LW · GW · 8 comments

This is a link post for https://eukaryotewritesblog.com/2019/09/01/tiddlywiki-for-organizing-notes-and-research/

Contents

    Things I like less
  How do I try it?
  Other research tools
None
8 comments

Happy new school year to my fellow students! With my first year of grad school under my belt, and my sword and shield out for Round 2, I wanted to share a tool that’s helped me on my journey.

Two years ago, my go-to system for organizing my research and writing “citations in 3 different programs” + “pile everything into a haphazard series of google docs and hope for the best”. I figured this wasn’t great. After doing some reading and trying several alternatives, I discovered Tiddlywiki.

Tiddlywiki is an ancient open-source wiki application in the form of an html file. It has all the tools you need to make a wiki in the form of “tiddlers”, self-contained chunks of info that you can tag and link to each other. When you save the wiki, the program and your text all get wrapped up together into the same .html file – it both stores your info and is the program for running the wiki. It works on any web browser, as well as special programs.

alt text

I stuck with it and here’s why:

Things I like less

The number of wikis you have is up to you. I started with one wiki for a specific writing project and one wiki for work, notes and research. My active Tiddlywikis now include:

Your mileage may vary.

How do I try it?

First, check out some tiddlywikis that have been converted into websites. Here’s a nice one to explore as an example, a thesis website in Spanish. Here’s one on philosophy. (Note that you can’t actually edit the versions that appear on the website. You can locally save the whole wiki and changes you make to it, though.)

If you like it, here are some resources to get you started. This is the official website, which has lots of helpful documentation. (Note that it’s also a tiddlywiki!)

Here are some youtube videos I also found helpful.

After making a few tiddlywikis, I found that I kept making the same tweaks to them to get them set up in a way useful for me. In that light, I made a new “blank” or “empty” tiddlywiki that had those changes baked in already.

Here it is: the Eukaryote Writes Blog empty tiddlywiki. You may find it better than the default empty wiki. It comes with a couple new color schemes, a table of contents, and some layout tweaks, among other small changes.

Other research tools

All hail the exobrain!

I keep track of research citations formally with Zotero, or the tool my work prefers. For informal reading, I’ll also just note the authors and title and/or URL of the source (in my tiddlywiki!) so I can find it later.

For keeping track of time spent working, I’ve gotten some utility out of KanbanFlow. I like the Pomodoro Technique, and KanbanFlow has both pomodoro timers and a nice task-sorting and task-prioritization system built in. I currently don’t worry about tracking time, and use Google Calendar, a bullet journal, and a bastardized Kanban Board variant to keep my brain in order.

Previously, I used the website MarinaraTimer to time pomodoros. I love it for exactly two reasons: the ability to pause pomodoros, and the sound effect “Ominous Woosh”.

8 comments

Comments sorted by top scores.

comment by Said Achmiz (SaidAchmiz) · 2019-09-02T04:14:06.686Z · LW(p) · GW(p)

I enthusiastically endorse the use of wiki software (and wikis) for almost any conceivable purpose. However, I have to say that, having investigated a variety of wiki platforms, TiddlyWiki in particular did not strike me as very promising.

My recommendation would be PmWiki, which (in addition to many other salutary qualities) is quite possibly the single most customizable platform of this type I’ve ever seen. There’s a truly staggering number of add-ons (called “recipes”) available (take a look at just the ones I’ve made and contribute to, for example).

Examples of sites and pages built with PmWiki are:

EDIT: What may be of particular interest to folks here is that PmWiki has support available for:

comment by Ted Pudlik (ted-pudlik) · 2020-04-02T07:08:36.992Z · LW(p) · GW(p)

In addition to embedding images in the HTML file (which, as you discuss, is not a great choice) TiddlyWiki allows linking external images. In particular, you can use relative paths to link to image files on the same drive as the TiddlyWiki. I use this functionality a lot. It has the disadvantage that your Wiki is no longer a standalone HTML file, but it's still a standalone folder, which is often good enough.

comment by Spee-dyreader · 2019-09-20T17:24:32.594Z · LW(p) · GW(p)

Please share your example of using Tiddlywiki for quotes.

Replies from: eukaryote
comment by eukaryote · 2019-09-21T02:56:58.796Z · LW(p) · GW(p)

Sure. It's not much right now.

I put each quote and source combo on their own tiddler, then tag it with a bunch of stuff that might help me find it later. I'll probably refine the system as I start referring back to it more.

comment by Robert Miles (robert-miles) · 2019-09-10T11:57:33.937Z · LW(p) · GW(p)

I used TiddlyWiki a lot for my PhD work and it was excellent, but haven't touched it since for some reason. Maybe I'll pick it back up.

One thing I remember doing was modifying the JS so that it linkifies any mention of a Tiddler, rather than only doing it when you put the name in the 'make this a link' syntax. I found it handy to have it so that any time I mentioned an author, framework, algorithm, dataset etc it would effortlessly be a link to my other notes about that topic. I'll see if I can find the files.

comment by Viliam · 2019-09-01T20:14:40.350Z · LW(p) · GW(p)

Thanks for the description! I found this software years ago, but somehow I didn't notice that you can save the data.

For people who like the idea of a wiki, but have some objection against Tiddlywiki, I would recommend trying WikidPad (desktop app, can save in one file, automatically generates page tree, supports lookup by keywords) or MediaWiki (online app, all functionality of Wikipedia including writing your own macros).

comment by John_Maxwell (John_Maxwell_IV) · 2019-09-02T22:20:34.891Z · LW(p) · GW(p)

Nice!

I've found the way my knowledge management workflow works is that I have particular future situations I anticipate being in, and I want to keep a list of things I'd like to be reminded of in that particular situation. (This is very broad and could include stuff like: I decide I want to write post X, or start company Y, or I'm struggling with problem Z, etc.) Usually this doesn't require a lot of nonlinear structure, I'm basically just looking at a bunch of lists. The most important feature is a hotkey for jumping to the list in question. Here is an old post with more details (which also has comments from others on personal knowledge management):

https://www.lesswrong.com/posts/stDijTKuto52M5wQT/personal-information-management [LW · GW]

The thing I'm least satisfied with is when bits of text belong in multiple lists, but the intersection of the two list domains doesn't feel broad enough to justify the overhead of a dedicated list. It sounds like the tiddler concept handles this situation pretty well. I wonder if autocompleting tags could be an effective substitute for my jump-to-note hotkey...

comment by gabriel montagné láscaris-comneno (gabrielmontagne) · 2022-06-08T15:31:57.749Z · LW(p) · GW(p)

TiddlyWiki is a great tool, incredibly flexible.  I've seen it camouflaged as basically any other app out there (Roam clones,  kanban boards, etc.). 

The best (and meatiest) example I've ever seen of a (public) personal knowledge base is Soren Bjornstad's, https://zettelkasten.sorenbjornstad.com/  .  He's the author of the -- in itself very impressive --  self-TW-hosted book https://groktiddlywiki.com/read/  He is also, in a way, a philosopher of the whole thing,