1
1
mirror of https://github.com/go-gitea/gitea synced 2024-11-01 15:54:25 +00:00
gitea/models/repo
Bruno Sofiato 900ac62251
Allow code search by filename (#32210)
This is a large and complex PR, so let me explain in detail its changes.

First, I had to create new index mappings for Bleve and ElasticSerach as
the current ones do not support search by filename. This requires Gitea
to recreate the code search indexes (I do not know if this is a breaking
change, but I feel it deserves a heads-up).

I've used [this
approach](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/analysis-pathhierarchy-tokenizer.html)
to model the filename index. It allows us to efficiently search for both
the full path and the name of a file. Bleve, however, does not support
this out-of-box, so I had to code a brand new [token
filter](https://blevesearch.com/docs/Token-Filters/) to generate the
search terms.

I also did an overhaul in the `indexer_test.go` file. It now asserts the
order of the expected results (this is important since matches based on
the name of a file are more relevant than those based on its content).
I've added new test scenarios that deal with searching by filename. They
use a new repo included in the Gitea fixture.

The screenshot below depicts how Gitea shows the search results. It
shows results based on content in the same way as the current version
does. In matches based on the filename, the first seven lines of the
file contents are shown (BTW, this is how GitHub does it).


![image](https://github.com/user-attachments/assets/9d938d86-1a8d-4f89-8644-1921a473e858)

Resolves #32096

---------

Signed-off-by: Bruno Sofiato <bruno.sofiato@gmail.com>
2024-10-11 23:35:04 +00:00
..
archiver.go Add support for sha256 repositories (#23894) 2024-01-19 17:05:02 +01:00
attachment_test.go More refactoring of db.DefaultContext (#27083) 2023-09-15 06:13:19 +00:00
attachment.go Azure blob storage support (#30995) 2024-05-30 07:33:50 +00:00
avatar_test.go Fix duplicate sub-path for avatars (#31365) 2024-06-15 11:43:57 +08:00
avatar.go Return an empty string when a repo has no avatar in the repo API (#31187) 2024-06-01 11:49:42 +00:00
collaboration_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
collaboration.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
fork_test.go refactor some functions to support ctx as first parameter (#21878) 2022-12-03 10:48:26 +08:00
fork.go Move more functions to db.Find (#28419) 2024-01-15 02:19:25 +00:00
git.go Add merge style fast-forward-only (#28954) 2024-02-12 23:37:23 +01:00
issue.go Clean up log messages (#30313) 2024-04-07 19:17:06 +08:00
language_stats.go Penultimate round of db.DefaultContext refactor (#27414) 2023-10-11 04:24:07 +00:00
license.go Support repo license (#24872) 2024-10-01 15:25:08 -04:00
main_test.go make writing main test easier (#27270) 2023-09-28 01:38:53 +00:00
mirror.go More db.DefaultContext refactor (#27265) 2023-09-29 12:12:54 +00:00
pushmirror_test.go Refactor deletion (#28610) 2023-12-25 21:25:29 +01:00
pushmirror.go Don't run push mirrors for archived repos (#27140) 2024-01-24 02:32:57 +00:00
redirect_test.go Final round of db.DefaultContext refactor (#27587) 2023-10-14 08:37:24 +00:00
redirect.go Final round of db.DefaultContext refactor (#27587) 2023-10-14 08:37:24 +00:00
release_test.go Add tag name in the commits list (#31082) 2024-08-19 17:04:06 +00:00
release.go Included tag search capabilities (#32045) 2024-09-18 02:33:11 +08:00
repo_indexer.go Add support for sha256 repositories (#23894) 2024-01-19 17:05:02 +01:00
repo_list_test.go Allow code search by filename (#32210) 2024-10-11 23:35:04 +00:00
repo_list.go bump to go 1.23 (#31855) 2024-09-10 02:23:07 +00:00
repo_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
repo_unit_test.go add disable workflow feature (#26413) 2023-08-14 15:14:30 +00:00
repo_unit.go Refactor repo unit "disabled" check (#31389) 2024-06-18 00:51:13 +00:00
repo.go Make GetRepositoryByName more safer (#31712) 2024-07-29 01:32:54 +00:00
search.go Rename repo_model.SearchOrderByMap to repo_model.OrderByMap (#31359) 2024-06-15 06:45:02 +00:00
star_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
star.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
topic_test.go Refactor topic Find functions and add more tests for pagination (#30127) 2024-03-29 11:38:16 +08:00
topic.go Refactor topic Find functions and add more tests for pagination (#30127) 2024-03-29 11:38:16 +08:00
update.go Move some repository transfer functions to service layer (#28855) 2024-02-05 06:17:23 +00:00
upload.go Refactor deletion (#28610) 2023-12-25 21:25:29 +01:00
user_repo_test.go Get repo assignees and reviewers should ignore deactivated users (#30770) 2024-04-30 08:43:08 +00:00
user_repo.go Get repo assignees and reviewers should ignore deactivated users (#30770) 2024-04-30 08:43:08 +00:00
watch_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
watch.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
wiki_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
wiki.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00