Advice - best way to use web scrapping for web project
I am looking for a bit of help on this project idea I have decided to launch.
1) Project Details:
The web project I have in mind is a website that will show the largest online database of cosmetics.
Basically, any product of any cosmetic brand will be on the website. (Or at least that is the objective here).
To reach this, I was thinking of using web scrapping to collect the info on each product, and save it in a database.
I have no idea how this can be technically implemented.
I wanted to use Joomla as the CMS tool and combine it with the web scrapping feature so the site can be updated on a weekly/monthly.
- That is technically possible?
- If it is complicated to develop?
- If it is legally possible?
Advice would be welcome here!
Perhaps there is another way to do it that I haven’t thought about??
In addition to this, there will be additional features such as:
- User accounts
- Add comments
- Social media feature
- Comparative feature
2) Payment method/ details (Paypal, check? Timeline?):
I have not thought about how much it would cost to do it.
I am still trying to find the best way to do it.
It is a serious project and I have a budget for it.