Hacker Newsnew | past | comments | ask | show | jobs | submit | smath's commentslogin

Huffman Coding! :-)

I too have to disagree with pg on that line `> having kids may make one less ambitious`. The fact is that the world is very very multi-modal, i.e. the brains of people and how they think are wildly different. I think having kids makes me more ambitious and more focused, and more selective re the problems I work on, partly because I am also setting an example.


Ah Sir David MacKay. I so respect him. Great explainer and speaker. He had built this text entry tool called Dasher [0] - that I'd heard him introduce at Princeton around 2006. It was basically an early language model that predicted which characters are more likely than others, given what you've already types and it would adjust the sizes of the available next characters based on their probabilities.

[0] https://dasher.at/about/


He really was fantastic, and prolific in multiple fields.

He wrote https://www.withouthotair.org/ (creative commons) and was the Chief Scientific Advisor to the UK Department of Energy and Climate Change.

Dedicated to "to those who will not have the benefit of two billion years' accumulated energy reserves".


I also went to a couple of his (fantastic) undergraduate courses, and have a huge amount of respect for him.

That said, I think it's worth mentioning that Climate Change Without the Hot Air has aged pretty badly, and I'd be reluctant to recommend it to people who don't already have the background to understand what's aged well and what hasn't.

The high level approach of making high level numerical estimates makes sense, but it dismisses solar energy in about a page due to assumed high costs. It turns out that even if you're David Mackay you can still be caught out by exponentials :) I notice now that the version you link has some inline updates pointing out how off the assumptions in this section were, but it seems to me that's not enough; you probably need to redo the entire analysis based on what we know today rather than trying to make purely local adjustments.

On the other hand the point at biofuels are even more inefficient, and therefore a dead end even before you consider broader environmental impacts, are well made and something that is sadly not yet widely reflected in policy.


> biofuels are even more inefficient, and therefore a dead end

Only if energy density doesn't matter. But it really does, though. Battery powered electric trucking? Dead end. Battery powered aviation? Dead end. Battery powered shipping? Dead end.

[edit] Maybe there's some sustainable way to convert solar energy into sufficiently energy dense fuels that isn't biological, but so far it seems like seed oils or algae are probably the least bad?


> It was basically an early language model that predicted which characters are more likely than others, given what you've already types and it would adjust the sizes of the available next characters based on their probabilities.

"adjust the sizes of the available next characters": you mean assigning less bits to characters the most likely to come next, and more bits to the least likely characters to come next?

So it's not totally unlike adaptive Huffman coding but instead of updating the tree on already visited characters, here the tree with the weights of the possible following character is predictive?


Adjust the size as in making the GUI element larger: https://en.wikipedia.org/wiki/Dasher_%28software%29 has a picture of completing "Wikiped".

Try it out: `apt install dasher`. https://packages.debian.org/sid/dasher


It is infact a visual implementation of arithmetic coding, and he used it in his lectures to teach arithmetic coding in the lecture following the one on huffman coding. The video lectures posted earlier are highly recommended, best course I took as an undergrad


This is a common source of confusion. The knitting / pottery making is not rewarding because its made by hands or is not knowledge work, but because it is done in the direct service of someone. Modern organizations are complex and can put several layers between the knowledge worker and the customer it ultimately serves. This produces the feeling of 'cog in a machine'. It is possible to work such jobs and serve others directly on the side (e.g. friday evening soup kitchen)


In a way it’s the same phenomenon as TV channels with fixed programming replaced by cable and the streaming video. Newspaper vs curated feeds. There is an exploit vs explore tradeoff in all of these. The newer versions lean heavier on exploit, so explore suffers. Explore is the ‘broadening horizons’ bit that some other comments refer to.

Automation / machines tend to make things more efficient and we shouldn’t shy away from automation, but they can also reduce the human connection. I think the same thing will happen with AI generated art - l human generated art can be a spiritual experience meaning you can connect with another human through art - but if a masterpiece like Cypress Trees in Wheat Fields is AI generated, there isn’t a connection with the human artist. Consequently we must consciously turn to other places to keep human connection strong.


Is it possible to acquire lower frequency components with a camera too?

This also reminded me of MRI where low frequency is acquired first in a space called k-space


My conclusion is that this in not the end of creativity but an increasing premium on creativity that is certified to be human made. It’s like how if I cook something from scratch that’s considered more meaningful than if I simply heated frozen food or ordered in for a guest.


Very cool! While this is a different type of inverse problem, it reminds me of a radiolab story [0] about a device to help blind people “see” using electrical impulses on a metal strip under the tongue.

[0] https://radiolab.org/podcast/seeing-tongues


Very fond memories of Mir Publishers' science and math books growing up in India in the 80s and 90s. I think English translations were freely available in India. My grandfather would buy them for me to encourage my interest in science and math. If I could find physical copies of those books I would buy them in a heartbeat today.

Slight digression: Russian cartoons from that era are also very interesting. One of my favorite short cartoon from that era (I still hum its music involuntarily): Ikarus and the Wise Men [0]

[0] https://www.youtube.com/watch?v=0Yk1mz23YFA


[flagged]


No. Soviet literature was intentionally translated and distributed abroad. That was the purpose of Mir, at least partially.

https://en.wikipedia.org/wiki/Copyright_law_of_the_Soviet_Un...


They only joined the UCC (Geneva Copyright Treaty) in 1973 though. That was less than twenty years before the USSR ceased to exist. All the works published in the USSR before 1973 weren't copyrighted in the West (it wasn't retroactive).


While that maybe true ( I know some folks who are reprinting them ), the translated editions from those days were all printed in USSR at Mir / Raduga / Progress presses itself. We've even had poets, writers and other luminaries from India visit Moscow for this and other things as part of cultural initiatives.


Are they trying to infer characters/words from brain waves? I would have thought the brain is thinking in concepts rather than actual words


no contradiction, both can be true, you think in concepts, then verbalize, which is what they capture


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: