Full Idea
Ordinary language is not the last word: in principle it can everywhere be supplemented and improved upon and superseded. Only remember, it is the first word.
Gist of Idea
Ordinary language is the beginning of philosophy, but there is much more to it
Source
J.L. Austin (A Plea for Excuses [1956], p.185), quoted by A.W. Moore - The Evolution of Modern Metaphysics Intro
Book Reference
Moore,A.W.: 'The Evolution of Modern Metaphysics' [CUP 2013], p.11
A Reaction
To claim anything more would be absurd. The point is that this remark comes from the high priest of ordinary language philosophy.