Update following referenced licenses and rules

[AyanSinhaMahapatra]

In case of referenced license files, update the logic to not follow and de-reference licenses when all the license leys in the referenced files are already present in the main license detection. This preserves the license conditions in case there are extra license keys in an expression.

References:

• OR identified as AND #3523
• Refine referenced_filenames in license rules #3547
• Refine referenced filenames #3547 #3681 (this is a follow up of)

Fixes #3523

Tasks

• Reviewed contribution guidelines
• PR is descriptively titled 📑 and links the original issue above 🔗
• Tests pass -- look for a green checkbox ✔️ a few minutes after opening your PR
  Run tests locally to check for errors.
• Commits are in uniquely-named feature branch and has no merge conflicts 📁
• Updated documentation pages (if applicable)
• Updated CHANGELOG.rst (if applicable)

[JonoYang]

@AyanSinhaMahapatra LGTM!

[JonoYang]

some tests are failing, i will run them locally and see if its a ci issue or not

[JonoYang]

I run pytest -vvs --test-suite all . and I fail 3 tests. Two of them are cli tests that pass when I just run pytest -vvs --test-suite all test/scancode/test_cli.py. The other test failure is tests/licensedcode/test_detect.py::TestMatchAccuracyWithFullIndex::test_match_has_correct_line_positions_in_automake_perl_file, where some spans are different than expected. I'm not sure if this is an issue or if the expected test results need to be updated. We also fail that test on the ci here: https://dev.azure.com/nexB/scancode-toolkit/_build/results?buildId=19044&view=logs&j=e968ac97-6fe5-5e03-7848-d38fdbd63e89&t=68b960ee-accc-5f66-8291-47be569f7afb&l=11813

[AyanSinhaMahapatra]

Thanks for the review @JonoYang Let me fix the tests, which were failing already before this