Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Data Quality and Radius Functionality in FastMode #105

Open
shiloSaadon opened this issue Dec 23, 2024 · 3 comments
Open

Improve Data Quality and Radius Functionality in FastMode #105

shiloSaadon opened this issue Dec 23, 2024 · 3 comments

Comments

@shiloSaadon
Copy link

When activating FastMode, the returned data is significantly limited, with many data points missing. Additionally, the radius property does not function as expected when FastMode is inactive.

The current behavior creates the following challenges:

FastMode: Returns a small amount of data, which is often incomplete or of poor quality.
Standard Mode: Provides richer data but does not restrict results to the specified radius, making it unreliable for targeted queries.
The desired functionality is to:

Obtain rich, complete data within a specified radius.
Ensure that the radius property works consistently, regardless of whether FastMode is active or not.
This improvement would greatly enhance data accuracy and usability for targeted searches.

Thank you!

@gosom
Copy link
Owner

gosom commented Dec 26, 2024

(1) the radius function works only in fastmode
(2) the data from fastmode are limited. This is documented in README

about (2) extra work needs to be done.
for (1) I don't know if radius can be supported. Let me know if you know how

@shiloSaadon
Copy link
Author

Thank you for clarifying the current behavior of FastMode and the radius functionality. I appreciate your detailed response. I have a few follow-up questions and requests:

  1. How FastMode Works
    Could you provide a brief explanation of how FastMode retrieves data? Understanding its inner workings might help identify a way to extract more detailed data or potentially enhance its capabilities.

  2. Enhancing FastMode
    Is there an easy way to modify FastMode to return more data? For example, would tweaking the request parameters or implementing a different scraping strategy make it possible to retrieve more complete or detailed results?

  3. Radius Support in Standard Mode
    Regarding the radius property, I understand it currently works only in FastMode. Could you point me toward the part of the code where this functionality is implemented? With a bit more insight, I’d like to explore adding radius support to the standard mode myself.

I understand extra work is needed for improving the modes and that radius support in Standard Mode may not be straightforward. Your guidance or insights would be greatly appreciated as I explore potential solutions!

Thanks again for your time and effort!

@gosom
Copy link
Owner

gosom commented Jan 2, 2025

all your questions can be answered by taking a look at the code:

https://github.com/gosom/google-maps-scraper/blob/main/gmaps/searchjob.go

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants