How to make a Python program to read and save information from a website?

Question

1.00/5 (1 vote)

See more:

<pre>I need to make a program that takes information from a specific (government) website that needs a login, and shows files to a user. The problem is that I don't know where to start, what language to use and which compiler.I need direction to continue with my project. I know the basics of several languages (java, python, c ++, html), but I didn't delve into any of them.</pre>

What I have tried:

<pre>
I tried to start a python code and then use javascrypt to call the file, but I can't make a connection to the website in question, which would be https://www.cnj.jus.br/pjecnj/Push/loginPush.seam. I don't know if I should make a whole program in JS, but I don't know if that way I could compile a graphical interface in software.</pre>

Posted 24-May-21 14:49pm

Lucas Dutra

Updated 24-May-21 21:45pm

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Richard MacCutchan · Accepted Answer · 2021-05-24T21:45:00

Solution 1

You are talking about web scraping, and Python has just the library to help you: Scrapy | A Fast and Powerful Scraping and Web Crawling Framework[^]

Posted 24-May-21 21:45pm

Richard MacCutchan

Comments

Lucas Dutra 25-May-21 12:56pm

but i need to do this for several simultaneous users and i don't have a server, with scrapy can i do this?

Richard MacCutchan 25-May-21 14:25pm

You do this from a client PC not a server. So everyone who wants to do it will need a copy of your finished product. Start by getting a basic version to work for just one user before trying to make it feature rich.