by RowandK » Mon Jun 06, 2005 3:40 pm
When I saw this post, I got in touch w jfuex off-line. His opinion here and some of what he said off-line represent the biggest hurdles ALCoder faces – perception and perspective. (For the record, J hadn’t tried ALCoder himself, but someone else in his company has and still expresses interest.)
First, so much of autocoding has been over-promised or dreams have not met reality. ALCoder’s position is that our product is another tool for the arsenal. ALCoder doesn’t expect to replace manual coding, but ALCoder plus manual coding (hybrid coding) sure can reduce expenses and project time.
Second, there are some things ALCoder does really, really well. If you need to identify document dates or names mentioned, ALCoder does as fantastic job DEPENDING ON point #3.
Point #3, Garbage-In, Garbage-Out. If the documents are in poor shape, or the OCR engine sub-standard, then the text ALCoder interprets will be lacking. Which leads to
Point #4. For many document collections, there is no way to tell how well ALCoder will perform until you run a representative sample through. If anyone ever claims they’ve got an automated system that will accomplish XX% accuracy without trying a sample, they’re blowing smoke. Estimates that use a hybrid approach depend on volume – the bigger the collection the more likely the vendor can achieve some metric. Which leads to
Point #5, Click-based autocoding software is a risky proposition. I’ve just claimed that you can’t really tell how well ALCoder will perform without trying a sample. Wouldn’t it suck to burn clicks to find out that your collection is no good for autocoding? For that reason, A.L.Coder LLC has moved away from click based process.
Point #5a is that we have not totally abandoned clicks. If you’ve got 10,000 tiffed emails, hey, $1,000 in clicks will do the job. When I first came out with the no-click license, I called a customer and said hey, for another $3k, I’ll bump you to the no-click license. She replied, no-thanks, we’ve only got another 10k documents, so we’ll just take another $1,000 worth.
I asked J, how much is the improvement worth? If you’ve got 50,000+ documents that need to be coded, would $6,000 justify a doubling (or more) of you manual coding throughput? ALCoder can do that.