Pricefield | Lemmy
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
@[email protected] to Lemmy [email protected] • 2 years ago

Chad scraper

sh.itjust.works

message-square
99
fedilink
1.05K

Chad scraper

sh.itjust.works

@[email protected] to Lemmy [email protected] • 2 years ago
message-square
99
fedilink
  • @[email protected]
    link
    fedilink
    163•2 years ago

    Everyone loves the idea of scraping, no one likes maintaining scrapers that break once a week because the CSS or HTML changed.

    • DigitalPaperTrail
      link
      fedilink
      108•2 years ago

      spite can be a great motivator, though

      • @[email protected]
        link
        fedilink
        21•2 years ago

        This one. One of the best motivators. Sense of satisfaction when you get it working and you feel unstoppable (until the next subtle changes happens anyway)

      • archomrade [he/him]
        link
        fedilink
        English
        4•2 years ago

        I feel this

    • @[email protected]
      link
      fedilink
      28•2 years ago

      I loved scraping until my ip was blocked for botting lol. I know there’s ways around it it’s just work though

      • Pennomi
        link
        fedilink
        English
        40•2 years ago

        I successfully scraped millions of Amazon product listings simply by routing through TOR and cycling the exit node every 10 seconds.

        • @[email protected]
          link
          fedilink
          15•2 years ago

          That’s a good idea right there, I like that

        • @[email protected]
          link
          fedilink
          6•2 years ago

          This guy scrapes

        • ferret
          link
          fedilink
          English
          5•2 years ago

          lmao, yeah, get all the exit nodes banned from amazon.

          • Pennomi
            link
            fedilink
            English
            12•2 years ago

            That’s the neat thing, it wouldn’t because traffic only spikes for 10s on any particular node. It perfectly blends into the background noise.

            • @[email protected]
              cake
              link
              fedilink
              English
              3•2 years ago

              Queue Office Space style error and scrape for 10 hours on each node.

      • @[email protected]
        link
        fedilink
        8•
        edit-2
        2 years ago

        You guys use IP’s?

        • @[email protected]
          link
          fedilink
          7•2 years ago

          I’m coding baby’s first bot over here lol, I could probably do better

        • synae[he/him]
          link
          fedilink
          English
          7•2 years ago

          Token ring for me baybeee

    • @[email protected]
      link
      fedilink
      8•2 years ago

      Just use AI to make changes ¯_(ツ)_/¯

      • Ann Archy
        link
        fedilink
        10•2 years ago

        Here take these: \\

        • @[email protected]
          link
          fedilink
          9•2 years ago

          ¯_(ツ)_/¯\\ Thanks

    • @[email protected]
      link
      fedilink
      11•2 years ago

      Or in the case of wikipedia, every table on successive pages for sequential data is formatted differently.

Lemmy [email protected]

[email protected]
Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Welcome to Lemmy Shitpost. Here you can shitpost to your hearts content.

Anything and everything goes. Memes, Jokes, Vents and Banter. Though we still have to comply with lemmy.world instance rules. So behave!


Rules:

1. Be Respectful

Refrain from using harmful language pertaining to a protected characteristic: e.g. race, gender, sexuality, disability or religion.

Refrain from being argumentative when responding or commenting to posts/replies. Personal attacks are not welcome here.

…


2. No Illegal Content

Content that violates the law. Any post/comment found to be in breach of common law will be removed and given to the authorities if required.

That means:

-No promoting violence/threats against any individuals

-No CSA content or Revenge Porn

-No sharing private/personal information (Doxxing)

…


3. No Spam

Posting the same post, no matter the intent is against the rules.

-If you have posted content, please refrain from re-posting said content within this community.

-Do not spam posts with intent to harass, annoy, bully, advertise, scam or harm this community.

-No posting Scams/Advertisements/Phishing Links/IP Grabbers

-No Bots, Bots will be banned from the community.

…


4. No Porn/Explicit

Content


-Do not post explicit content. Lemmy.World is not the instance for NSFW content.

-Do not post Gore or Shock Content.

…


5. No Enciting Harassment,

Brigading, Doxxing or Witch Hunts


-Do not Brigade other Communities

-No calls to action against other communities/users within Lemmy or outside of Lemmy.

-No Witch Hunts against users/communities.

-No content that harasses members within or outside of the community.

…


6. NSFW should be behind NSFW tags.

-Content that is NSFW should be behind NSFW tags.

-Content that might be distressing should be kept behind NSFW tags.

…

If you see content that is a breach of the rules, please flag and report the comment and a moderator will take action where they can.


Also check out:

Partnered Communities:

1.Memes

2.Lemmy Review

3.Mildly Infuriating

4.Lemmy Be Wholesome

5.No Stupid Questions

6.You Should Know

7.Comedy Heaven

8.Credible Defense

9.Ten Forward

10.LinuxMemes (Linux themed memes)


Reach out to

All communities included on the sidebar are to be made in compliance with the instance rules. Striker

  • 1 user / day
  • 216 users / week
  • 4.11K users / month
  • 10.5K users / 6 months
  • 3 subscribers
  • 16.6K Posts
  • 367K Comments
  • Modlog
  • mods:
  • Aer
  • Striker
  • @[email protected]
  • Decoy321
  • @[email protected]
  • @[email protected]
  • The Picard Maneuver
  • Flying Squid
  • The Picard Maneuver
    cake
  • UI: 0.18.4
  • BE: 0.18.2
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org