For fruit recognition there are no low-hanging fruit !
I suggest you take on a project with much more limited goals. Consider how necessary the haptic sense (touch), and the olfactory sense (smell), are in recognizing the "ripeness state" of many fruits, in addition to the visual !
You could do some visual screening based on the appearance of "blotches," or variations from a standard range of colors, but remember a lot of fruit (in upscale American groceries, anyway) is "doctored" to look good.
For certain specific fruit (bananas), you might be able to use color alone to estimate ripeness.
See: [
^], [
^].
And, think about the problem of just scanning for blotches: you'd need multiple scans to cover the whole fruit, depending on shape.