Click here to Skip to main content
15,879,096 members

The Insider News

   

The Insider News is for breaking IT and Software development news. Post your news, your alerts and your inside scoops. This is an IT news-only forum - all off-topic, non-news posts will be removed. If you wish to ask a programming question please post it here.

Get The Daily Insider direct to your mailbox every day. Subscribe now!

 
GeneralRe: deepin Linux V23 can replace Windows 11 on your PC Pin
Nelek22-May-23 5:11
protectorNelek22-May-23 5:11 
GeneralRe: deepin Linux V23 can replace Windows 11 on your PC Pin
TNCaver23-May-23 5:39
TNCaver23-May-23 5:39 
NewsItaly allocates funds to shield workers from AI replacement threat Pin
Sean Ewington21-May-23 18:01
staffSean Ewington21-May-23 18:01 
GeneralRe: Italy allocates funds to shield workers from AI replacement threat Pin
Nelek22-May-23 5:17
protectorNelek22-May-23 5:17 
GeneralRe: Italy allocates funds to shield workers from AI replacement threat Pin
Daniel Pfeffer22-May-23 6:44
professionalDaniel Pfeffer22-May-23 6:44 
GeneralRe: Italy allocates funds to shield workers from AI replacement threat Pin
Nelek22-May-23 11:26
protectorNelek22-May-23 11:26 
NewsCEO: Raspberry Pi is “where we said we’d be” for 2023, recovery to follow Pin
Sean Ewington21-May-23 18:01
staffSean Ewington21-May-23 18:01 
NewsAll languages are NOT created (tokenized) equal Pin
Sean Ewington21-May-23 18:01
staffSean Ewington21-May-23 18:01 
In this article, I explore the tokenization process and how it varies across different languages: Analysis of token distributions in a parallel dataset of short messages that have been translated into 52 different languages, some languages, such as Armenian or Burmese, require 9 to 10 times more tokens than English to tokenize comparable messages, the impact of this language disparity, and this phenomenon is not new to AI — this is consistent with what we observe in Morse code and computer fonts.
So, to maximise cost savings ... pass the input through Google Translate first?
GeneralRe: All languages are NOT created (tokenized) equal Pin
Nelek22-May-23 5:17
protectorNelek22-May-23 5:17 
JokeRe: All languages are NOT created (tokenized) equal Pin
Daniel Pfeffer22-May-23 6:47
professionalDaniel Pfeffer22-May-23 6:47 
NewsLately I've been using timers daily Pin
Sean Ewington21-May-23 18:01
staffSean Ewington21-May-23 18:01 
NewsToday's cartoon Pin
Gary Wheeler19-May-23 2:26
Gary Wheeler19-May-23 2:26 
GeneralRe: Today's cartoon Pin
PIEBALDconsult19-May-23 3:09
mvePIEBALDconsult19-May-23 3:09 
GeneralRe: Today's cartoon Pin
obermd19-May-23 3:48
obermd19-May-23 3:48 
NewsHuman trial of mRNA universal flu vaccine begins Pin
Sean Ewington18-May-23 7:16
staffSean Ewington18-May-23 7:16 
GeneralRe: Human trial of mRNA universal flu vaccine begins Pin
Marc Clifton18-May-23 8:30
mvaMarc Clifton18-May-23 8:30 
GeneralRe: Human trial of mRNA universal flu vaccine begins Pin
Daniel Pfeffer18-May-23 11:48
professionalDaniel Pfeffer18-May-23 11:48 
GeneralRe: Human trial of mRNA universal flu vaccine begins Pin
Nelek18-May-23 23:51
protectorNelek18-May-23 23:51 
NewsWidely used chemical strongly linked to Parkinson’s disease Pin
Sean Ewington18-May-23 7:16
staffSean Ewington18-May-23 7:16 
NewsAddressing GitHub’s recent availability issues Pin
Sean Ewington18-May-23 7:16
staffSean Ewington18-May-23 7:16 
NewsWhat happened with ASUS routers this morning? Pin
Sean Ewington18-May-23 7:01
staffSean Ewington18-May-23 7:01 
GeneralRe: What happened with ASUS routers this morning? Pin
Nelek18-May-23 8:14
protectorNelek18-May-23 8:14 
GeneralRe: What happened with ASUS routers this morning? Pin
Marc Clifton18-May-23 8:28
mvaMarc Clifton18-May-23 8:28 
GeneralRe: What happened with ASUS routers this morning? Pin
Daniel Pfeffer18-May-23 12:10
professionalDaniel Pfeffer18-May-23 12:10 
NewsGoogle Analytics 4 Has Me So Frustrated, We Built Our Own Analytics Service Pin
Sean Ewington18-May-23 6:31
staffSean Ewington18-May-23 6:31 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.