Ya bro it's totally not possible to defeat a detection system that, in its own marketing on contrived, game-able benchmarks that they created, claims only a 99.6% true negative rate.
As stated, it's work product. Not a toy "adversarial prompt," so I won't be posting it here.
And as stated, even Pangram's own marketing material claims at least a 0.4% false negative rate on their own contrived corpus. A one in 250 event is hardly even rare.
You seem quite defensive about Pangram, and it shows up in a few of your comments. Is there a reason for that? If it's extending to outright denial of Pangram's own stated error rates... sheesh... very weird indeed (unless they're paying you, obviously).
What I said is that every time Pangram has said 100% AI, it is 100% something I don't want to read. I don't particularly care if it was written by humans or LLMs.
Every time I've asked for evidence from someone who claims something like you do there always seems to be a reason it can't be posted. So it makes one suspicious.
Is there no way you can modify your prompt to be shareable?
> I never found a piece of text that pangram claims is 100% AI that to me seems like purely human written text.
That's another claim you made, which is quite silly. You've never found something that Pangram marks as 0% human and which you deem to be 100% human? Huge gulf.
And no, not really. It's copy from fundraising materials. Removing the identifiable portions of it would remove virtually everything, which is perhaps why Pangram didn't flag it?
I said it wasn't something I wanted to read. Humans are capable of writing things I don't want to read. Which at this point is starting to include your comments.
I did and it's true, but I amended my statement at the top of this thread, which you've ignored.
What I wrote is true (it is a claim about my experience), so I'm not sure what you're attacking.
I amended my statement to avoid a discussion about the provenance which is not what I actually care about. What I care about is if I want to read it. Humans could theoretically write something in AI voice and if they did, I wouldn't want to read it.
I have not seen any examples of human text in LLM style that clearly predate 2023. If you can supply one, that would be incredible evidence.
If you're able to supply a prompt which generates text that fools pangram and is not like one sentence long or a list of names or something, but actual prose I want to read, then I will concede.
Oh, well sure, but I don't care about your preferences for what you'd like to read. You can use a Ouija board to decide whether something is worth reading for all I care, just don't use it to accuse other people of plagiarism or dishonesty.
Duh.
If your statement was "my super special dowsing rods tell me what I want to read with 100% accuracy" I'd say "cool." But that wasn't your claim.
> If you're able to supply a prompt which generates text that fools pangram and is not like one sentence long or a list of names or something, but actual prose I want to read, then I will concede.
This is an even more conservative claim than the one you just made! Sheesh.
I don't know if putting a disclaimer at the very end of the blog, that you also disclaim, should be considered "very clear".
"Here is, for those that have read this far, the acknowledgements that used to be in the formal paper but we decided to remove it, mostly because the paper has been reworked and rewritten so many times by us."
> I never found a piece of text that pangram claims is 100% AI that to me seems like purely human written text.
Is that the level of sensitivity we're looking for? More than literally 0%? Do you know how crazy it'd be to achieve that, even if they were trying to?
I have 1000s of reddit and hacker news comments from before 2023, and lots of long form writing too. But as you point out, those are all in the training set, and in pangram's "definitely human" training set too.
The ones that sound like LLMs tend to be the ones that were well researched and spent more time on, not the off the cuff stuff, which is most of what I write. So it would take me a while to find something like that.
But you're welcome to dive into my reddit and HN history, or all my blog posts on the wayback machine if you want to look for one. :)
How would your scheme work? You use RSA to encrypt the entire thing? Or you use it to get a key for a block cipher and then use that?
I feel like either way, you'd need the key to be different for every CD, otherwise you could just share the shared key. But if the encryption of every CD is different, why not just share the block cipher key directly? They can have a list of CDs and the associated key(s).
What additional security or functionality does an RSA like step add here?
No. That cracking group would have known a priori the phone call was a pretense, because id was very unlikely to press distinct CDs. So they could focus on conventional cracking techniques.
Maybe have n versions of the CD (maybe 16, or 32), so there are n decryption keys. When the buyer recites the code over the phone, the program run by the salesperson can identify which key is used based on the number.
The hacker groups would be a little frustrated trying to find all of the different CDs.
The setup costs for a pressed CD are substantial - manufacturing many different designs would have been much more expensive, and would have only slowed down crackers marginally. It's unlikely that this would have recovered enough sales to be worth it.
A reminder that CD-ROMs are pressed from glass masters, not burned like CD-Rs. I wonder if anyone has tried something like this with burned discs, though.
The multisession standard actually afforded the possibility of CD-PROM; a hybrid disc with a pressed read-only session followed by a writable section. It was only used for Kodak Picture CD (not the same as Photo CD) to hold software in the pressed session. It also apparently standardized a magneto-optical hybrid that never made it to market.
Hmm, it could work then if they’ve pressed most of the game data first and then recorded the encrypted part for each disk. But I guess the tooling for such setup would still be too expensive.
With CD-Rs it was already possible in the mid '90s, if we're talking mass production. CD-Rs are a little more expensive to produce, but not much more so. A slight concern is that readers of the time might not have been able to read the discs, because CD-Rs are not quite as reflective as CD-ROMs.
You would need some sort of hardware serial number system for PCs and a whole security infrastructure to verify that the serial number being used for the unlock wasn't faked. Then you could do per-PC unlocks. I'm not aware of anything like that being widespread back in the Quake days, though these days every computing device you own probably has a unique ID burned into ROM somewhere.
I wish school curriculum included things like "how printing actually worked through ages". Monks writing out manuscripts is somewhat relatable since we all (at least for now) still learn how to write. Everyone is taught the Gutenberg press was a big deal -- but how did it actually work? Why was it still a pain and how did later inventions fix those problems?
I was able to do something probably few have, which is visit one of those small hole in the wall museums staffed essentially by just a single passionate old guy assembled with his life savings, dedicated to the printing press. Incredible experience.
Anyways, it’s been about 15 years, but the thing that made an impression on me was that it wasn’t just one invention. Gutenberg basically had to assemble like two dozen separate innovations to make it all work.
The type alloy (3 metals!) had to be just soft enough to cast easily, just expandable enough to set well, just hard enough to last. How to cast in quantity and re-melt as needed. The ink had to be just runny enough to apply easily but not so runny it gets everywhere, sticky enough to stick to type, and dry at a good middle speed. The blotter to apply the ink to type. The system of wooden casing to hold the pieces together with the right spacing, that won’t fall apart. How to set up the casing. The screw press needed to have very even pressure. The paper needed to be able to slide and take ink properly without spreading but also not tear. Proper fonts and ligatures for the type. And so on…
IIRC most things stayed pretty similar for a few hundred years, mostly changing stuff like the paper feeding mechanism or tweaking ink application or minor variations in how the lever or screw work. So to be honest, Gutenberg did almost all the hard work himself. It was a big deal because a lot of these smaller inventions had to come together for a narrow purpose all at once (on top of the obvious huge historical effect of cheaper books!)
Thank you for taking the time to type that, I found it informative and interesting. Like we like to think of it as a single idea that worked well, but it's actually a ton of work to get a million details just right, and failure in just a few of them would just have made the whole endeavor (of the printing press) fail.
The Crandall Printing Museum! Yeah he used to do live demonstrations and everything, to the degree where he would cast a type piece right there in front of you from the liquid metal! Super cool guy, crazy knowledge about even tiny details. Sadly the original near-one man show passed away about a decade ago, but apparently the family has some role still in running it (I think the son runs the tours now?) since they just barely saved it all from being shut down and sold off, so it’s still around! https://www.thecrandall.org/collectionhttps://youtu.be/p9ikfO0MHQE if you wanted to get a glance at what they had/have. Even a linotype machine too!
Really fond memories of my visit, you can tell when someone is passionate.
I once celebrated my birthday where I asked everyone to give the following gift to me: create a presentation or workshop about something you're passionate about in your life. Treat us like experts and go down into your level of thinking, even to the tiniest amount of details. Don't be afraid if we don't fully follow or ask you to explain some terms. I'm hyped to hear what you come up with.
It was such a fun birthday. It was basically a conference, haha.
Gutenberg's press was made out of a wine press. Letters were cast in lead, then lined up on a tray under the press. The tray was inked. A piece of paper was set over the inked letters, and the wine press forced the paper onto the letters. This cut the cost of a book by a factor of 300(!).
The trouble for Gutenberg was it was too easy to duplicate his press, and that combined with not being good at business led to his bankruptcy.
And Gutenberg still was shooting for the high-end of the market -- he had his printed Bibles touched up by artists (Illuminated capitals, some color added here and there), meaning his Bibles weren't much cheaper than hand-copied because he believed that nobody wanted just cheap, functional books.
Commoners weren't literate in those days, so I expect his literate customers would be wealthy and would be willing to pay for an illuminated book.
But as books proliferated, it suddenly became advantageous for commoners to learn to read (the Bible was the typical primer used), and a virtuous cycle began and revolutionized everything.
And at least as important are the surrounding economic, social, and archival systems for printed information. How much of the populace was literate? Was there licensing (for copyists or printers), copyright, public domain, or public libraries? Distribution systems? What sorts of material were being copied or printed? And how long did those materials physically last? My understanding is that there's a vast amount that we don't know about Ancient Rome, because their "paper" was papyrus - cheap and easy to make, but easily destroyed by rot in damp environments and by crumbling in dry environments.
All of those considerations are predicated on having the printing press first. There is little value in advanced literacy if written knowledge is rare or hard to come by. There is no need for licensing if verbatim copying takes a lifetime rather than an afternoon. Why would someone need an elaborate distribution system if their output is limited to (let's say) 2 books/year?
Not sure what you mean by "advanced literacy", but credible experts seem to put literacy rates in Ancient Rome (zero printing presses) in the neighborhood of 20%. If you consider how little demand (for printed material) there could be from slaves, rural peasants, and such - that's damned high.
You seem focused on books with enormous page counts, requiring 6 months to a lifetime to copy. That's really not how societies without modern (ultra-cheap) printing technology did things. Same as their horse-drawn carriages didn't weigh anywhere near what a modern SUV does.
(Yes, hand-copied Bibles were big. And rare. Are you trying to judge the size and cost of typical medieval buildings by the surviving the cathedrals and castles?)
> I wish school curriculum included things like "how printing actually worked through ages". [...] Everyone is taught the Gutenberg press was a big deal -- but how did it actually work?
Just go to technological museums in cities near you: there you can see and learn all these things.
That’d be nice, as a news nerd and pagemaker monkey myself. But school curriculums don’t even have the space to teach touch typing anymore. Or huge chunks of U.S. history (nevermind histories of countries far older).
That's really awesome! Did they have you try and typeset something by hand? I feel like for us it presented as some magical thing that made producing books trivially easy, whereas in reality typesetting a page was still very labor intensive and not that fast!
We learned about how the Gutenberg Press physically worked, how it was based on wine presses and how difficult it supposedly was to produce a single metal letter. Also, how it was a PITA to re-arrange them to print something else, alas it was mostly used to print the Bible.
I think even the printing was still not _that_ fast. You needed to physically press down each page. Make sure the ink was right, replace the paper, make sure not to smudge anything, etc.
I'd be surprised if they could average more than 2 pages / minute? Which for 1000 pages is still a full days work.
Compare 30 seconds to print a sheet to the cost of pulling hundreds of letters out of bins, tossing worn ones out, casting new replacements, lining them up, inserting spaces, and proofreading. I'd probably want to print 1000 sheets before setting up another page.
I was involved a bit in printing manuals in the 1980s. The cost of printing 100 copies vs 1000 copies was pretty much the same. The delta is the cost of the paper.
> overestimate how well they learn things without the feedback of formal education
People benefit greatly from external human feedback, but 1:1 tutoring (with a good tutor) is roughtly an order of magnitude more effective and efficient than a classroom, and classrooms themselves vary wildly; in general the more participatory the better.
Self learning without any help can be more effective and efficient than a typical classroom, because as it is self directed, self paced, can use the best materials someone can find and a whole variety of them vs. whatever was assigned, etc., but it takes a lot of skill (which comes from past practice) and effort on the part of the learner. Many researchers/scholars are doing significant amounts of self-directed learning as their career, and can get very good at it with decades of practice.
The speed of learning in a classroom with 15+ students is inevitably unbelievably slow, and the time is used incredibly inefficiently. This isn't any particular problem with specific teachers, but as far as I can tell an inherent problem with aligning a bunch of people's preparation, motivation, and attention, and a problem with giving feedback in a 1:many setting. Teaching/learning speed generally seems worse at a primary school level vs. at a college level, given a very good teacher in both; I'm not sure if this is because of better prepared (because older) students, or just more motivated students.
Formal education is wider than just 15+ people classrooms. Apprenticeships don’t require removing people from the workforce, but they require feedback to function well not just watching a master craftsman.
Yes, apprenticeships are an interesting model. And in practice, whether formalised or not, it's how a lot of professions are taught to this day: as an example compare what they teach at university vs what you actually need on the job for your favourite white-collar profession. Some places, like management consultancies or investment banks, don't even require any specific degree.
It’s not only feedback, having arbitrary checkpoints like exams is an important motivator, and it also creates a whole culture around it that makes the learning experience into a social one.
English is my second language I learned outside of school. Formal education is pretty worthless all around in my experience, as they only tell you what you should learn on your own but make no effort to actually teach you. Otherwise every person leaving school would be fluent in at least two languages.
The most incredulous part is how easy it was to learn English on my own. It took less than two years after having failed to do so with 10+ years in school.
No, no, just the opposite: school curricula are full of lofty highfalutin ideas.
I didn't say anything is hopeless. It's just that adding more good and lofty ideas and topics to the curriculum isn't addressing the actual bottleneck.
Yet the end result appears that people on their own accord go and "learn" things like vaccines are bad, fluoridated water is used for mind control, rectal enemas can cure bowel cancer, and that the moon landings were fake.
At least the education system enforces some baseline level of standards
I think one reason is also the style? Like you can not like the LLM style and that's a perfectly valid to reason to not like it.
Attacking the use of LLMs might just be shorthand for the style or the long-winded vacuousness that people don't like.
I agree that if someone used an LLM and the result is _good_, I'm not sure I would care. But that generally doesn't happen yet, so one is a proxy for the other.
reply