Holle Meding<p>🕰️ Small but time-aware!</p><p>At the " <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> for for the History, Philosophy, and Sociology of Science workshop" <span class="h-card" translate="no"><a href="https://wisskomm.social/@tuberlin" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>tuberlin</span></a></span> Jochen Büttner presented a compact small language model (39M parameters) that integrates a temporal dimension for historical text analysis.</p><p>A proof of concept using historical UK weather reports shows the model successfully reflects both seasonal patterns and linguistic shifts</p><p>Wanna try it? <br>👉 github.com/j-buettner/time_transformer</p><p><a href="https://mastodon.social/tags/DigitalHumanities" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DigitalHumanities</span></a> <a href="https://mastodon.social/tags/Transformer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Transformer</span></a> <a href="https://mastodon.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NLP</span></a></p>