Impact of size of database on query performance

How much does the overall size of the database impact query performance? For example, if I have measureA which is taking 80% of the overall large (say 500GB+) database, would a query referencing data on measureB be significantly impacted on performance?