Peter have you had a test with a hammer and bolster to see if it'll come off that way? I wouldn't have thought it would bond to a decent terrazzo finish very well
If it's a bigger area you can hire a medium electric breaker with a floor scraper attachment, just like a giant paint scraper really. When I used to work in the building trade we used these to get marley tiles off floors where they were compacted down. The blade on them is nice and thin so you can get it under the layer of stuff you're trying to remove. Can't go too mental with them though or you knacker the scraper tool.
Failing that just a normal bolster tool on a breaker would possibly do it, but would make a bit more of a mess of the terrazzo!