People were taken aback, primarily because they have the exact opposite in their heads.
I explained that knowledge has various categories and sciences. Furthermore there is one science that is exoteric (zahir) and another esoteric (batin), and the grasp of each is difficult.
This is not the case with observance ('amal) because it concerns the Self (nafs, or soul). So long as it remains lethargic it seizes to practise but once the lethargy is fought off and is prepared/determined to undertake action, then observance becomes easy and no longer remains difficult.
It is for this reason devout worshippers are visible everywhere, yet it is difficult to find a talented scholar. Towns and districts are empty of erudite scholars even though the Qur'an and Hadith bear explicit and exclusive virtues for acquiring knowledge and the people of knowledge.
Take, for example, the Hadith, "the virtue/excellence of a scholar over the worshipper is that of my virtue/excellence over the lowest amongst you." (فضل العالم على العابد كفضلي على أدناكم) (Tirmidhi 2685) Subhan Allah, what an incredible virtue this is. Only the Prophet, and none other, could have made such a statement. Now who would have the audacity to disparage this position set by the Prophet himself?
It is worth mentioning, however, that this virtue is only for the true God-fearing scholar (alim-e-rabbani), not the ostentatious and name-sake scholar. This is because Jewish scholars who gave in to material temptations have been despised in the Qur'an on numerous occasions. The Quran says about such a people: "Will you command others to piety and forget yourselves..." (2:44)
The author of ruh al-bayan (Alusi) submits the following exegesis under the cited verse, each scholar should reflect deeply upon it and judge himself individually:
This penalisation is worth thinking about. The unobserving scholar will receive torment even before the Idolaters. Can there be greater admonishment for scholars beyond this? And is this not enough to call upon scholars to fill their hearts with fear? If this is not, then what will?
Therefore and, in conclusion, the scholar is more worthy of observing fear and austerity than others. Furthermore, and by extension, it necessitates that he acquires thorough knowledge of right and wrong (ma'ruf wa munkar), so that he can observe the right and abstain from wrong himself as well as guide others accordingly. This will bring [much-needed] reformation (islah). And Allah is the Custodian of Assistance.