当前位置: 首页 > news >正文

python爬虫实战

import requests
import json
yes=input('输入页数:')
yes=int(yes)headers = {"accept": "application/json, text/plain, */*","accept-language": "zh-CN,zh;q=0.9","content-type": "application/json","origin": "https://www.gaokao.cn","referer": "https://www.gaokao.cn/","sec-ch-ua": "\"Google Chrome\";v=\"123\", \"Not:A-Brand\";v=\"8\", \"Chromium\";v=\"123\"","sec-ch-ua-mobile": "?0","sec-ch-ua-platform": "\"Windows\"","sec-fetch-dest": "empty","sec-fetch-mode": "cors","sec-fetch-site": "cross-site","user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36"
}
url = "https://api.zjzw.cn/web/api/"
ff=open('x.csv','w')
for paga in range(1,yes):params = {"big_min": "750","keyword": "","local_batch_id": "","local_province_id": "32","local_type_id": "2073","page": str(paga),"province_id": "","size": "20","small_min": "0","type": "","uri": "apidata/api/gk/score/province","year": "2023","zslx": "0","signsafe": "7c6422ab7db981d40fe7115c1b439de2"}data = {"big_min": 750,"keyword": "","local_batch_id": "","local_province_id": "32","local_type_id": "2073","page": paga,"province_id": "","signsafe": "7c6422ab7db981d40fe7115c1b439de2","size": 20,"small_min": 0,"type": "","uri": "apidata/api/gk/score/province","year": "2023","zslx": "0"}data = json.dumps(data, separators=(',', ':'))response = requests.post(url, headers=headers, params=params, data=data)res=response.json()for i in res['data']['item']:a=i['city_name']b=i['county_name']c=i['dual_class_name']d=i['local_batch_id']e=i['local_batch_name']f=i['local_province_name']g=i['local_type_name']h=i['name']j=i['nature_name']k=i['province_name']l=i['sg_info']m=i['zslx_name']n=str(i['min'])ab=a+bsg_name='专业组'+i['sg_name']ff.write(','.join([h,a,b,g,e,c,sg_name,l,n,d,f,m,j,k,'\n']))
ff.close()

http://www.lryc.cn/news/343763.html

相关文章:

  • k8s 资源文件参数介绍
  • mac系统安装steam报错-解决办法
  • 这个簇状柱形图怎么添加百分比?
  • Tomact安装配置及使用(超详细)
  • web后端——netbeans ide +jsp+servlet开发学习总结
  • 使用request-try-notifyState流程实现UI控制与状态反馈的完整闭环
  • 屏蔽罩材质和厚度对屏蔽效能的影响
  • Qt简单离线音乐播放器
  • 微信小程序常用的api
  • iOS xib布局
  • UNI-APP_拨打电话权限如何去掉,访问文件权限关闭
  • Git知识点汇总表格总结
  • 漫谈:C语言 奇葩的指针定义规则
  • spring boot中一般如何使用线程池
  • Shader 纹理动画和顶点动画
  • 使用macof发起MAC地址泛洪攻击
  • 力扣:1979. 找出数组的最大公约数(Java)
  • 电瓶车充电桩:潜藏的暴利行业,简单入门到月入万元!
  • mac监听 linux服务器性能可视化(Grafana+Promethus+Node_exporter)
  • 【负载均衡在线OJ项目日记】运行功能开发
  • Qt | QLineEdit 类(行编辑器)
  • Mamba结构的Demo源码解读
  • 金仓面对面 | 人大金仓×安硕信息共话金融信用风险管理数字化转型之道
  • JavaScript值类型与引用类型的区别
  • 每日一博 - 闲聊架构设计中的多级缓存设计
  • 轻松实现MySQL集群配置:一主一从与一主多从教程
  • Leetcode刷题-(41~45)-Java
  • 【Android】源码解析Activity的结构分析
  • 小猪APP分发:重塑应用分发市场的创新力量
  • 区块链 | IPFS 工作原理入门