All the content, none of the Spez? Or, is it better if Lemmy stays distinct?
Please don’t do this.
I think the community is much more important than just having more content. I would worry that by flooding Lemmy with Reddit’s content without the community to support that content could drown everyone out.
Yeah I agree. I think being able to tweak a personalised scraper as an opt in service per community could work. Some subs just won’t work for this, like askreddit and Eli5, but niche communities, news communities and information communities. I would be happy just seeing the top 2 or 3 posts of the day for some, and for world news for example, only the posts that pass a certain threshold of upvotes in a certain time or against the subs size, to make sure the real news pops up quick.
Nah. This is a fresh start. It’s been less than a week and theres already so much more content. It’ll grow soon enough. Especially with spez fucking around over there. We want og content here, not all the shit reposts that already plague reddit
Time to get to work.
Cracks knuckles
Everyday the experience gets better. It’s great to see, and I’m glad I’m here for it. I’ve never known social media to bring me actual joy.
If I wanted to lurk Reddit, I would just do that. Better to stay your separate thing. It is nice to sometimes get news about the other side of the fence.
If you wanna write code to do this … I’d say skip the bot, write a gateway instead.
Back in the early days of email, there were lots of different email systems, not just the SMTP Internet email we use today. There was UUCP email with “bang paths”, where your email address specified a list of servers that a message could be passed through to get to you. There were other networks like FidoNet and WWIVnet, that could send email to Internet email addresses through special “gateway” servers.
A gateway receives messages using one protocol or service, and retransmits or makes them available on another protocol or service.
For a little while in 1992, I had access to read Usenet posts only through a gateway that exported Usenet posts onto the Gopher system.
A gateway between Reddit and Lemmy would appear to Reddit as a web browser, scraping posts and comments; while appearing to Lemmy as a Lemmy instance that users could subscribe to, making each subreddit it scrapes available as a Lemmy community.
So a Lemmy user could subscribe to, say, [email protected] and see a fresh view of AskReddit. The server at reddittolemmy.com would not be a standard Lemmy server with users, but rather a custom gateway server that fetches data from Reddit and makes it available in the form of a Lemmy community.
(If Reddit were not being an asshole, a gateway could be an API client. But Reddit is being an asshole, so a gateway should probably be written as a scraper that accesses Reddit as if it were a normal user using a desktop Web browser.)
This is a great idea.
I don’t particularly think the whole of Reddit needs to be scraped though. I could be happy with only scraping posts that pass a certain thresh hold of votes against the subreddits subscriber count and maybe getting those crossposted to the Lemmy equivalent communities that want to opt in to such a service. This would be especially useful for World News and the more niche subreddits that don’t yet have a big enough userbase here
The hard part isn’t describing which posts or comments need to be gatewayed.
The hard part is being able to deliver posts and comments across the gateway at all.
eh, maybe wait until 0.18 rolls out across the fediverse before scraping reddit for content
Oh? What’s that going to do? I’m out of the loop.
0.17.4 is what is used now and it has a number of issues - included the new/scrolling bug. 0.18 is supposed to fix that & other issues as well.
I think it’s like breaking up with someone and then dedicating yourself to building a weird, soulless android version of your ex.
Removed by mod
deleted by creator
You could dedicate a community to reddit reposts easy enough. If people want to see the stuff from reddit they can sub, if they would rather wash their hands of reddit they can ignore it or block it.
I would rather have content posted by humans. Lemmy doesn’t need to be reddit anyway.
Thoughts: Content is good atm. If it’s spammy it’ll get blocked. Or the instance de-federated. Is going to Reddit boosting reddit or draining it by using the content. Reddit has a lot of bad content that Lemmy is free of.
But I also liked the…(whispers) cosplay…
In general, I really do not like this idea. Lemmy is Lemmy and should not, directly or indirectly, turn into Reddit.
Use what fediverse is good at. Make an instance where these bots reside and anyone who doesn’t want them can just defederate.
deleted by creator
It’s inconvenient, but not impossible. The content could be scraped instead of handed over directly via the API.
An explanation, if you’re interested:
API stands for Application Programming Interface. It is a way for two software applications to communicate with each other. APIs are often used to access data from websites. When you use an API, you are essentially asking the website for the data you need. The website will then provide the data to you in a format that your software can understand.
Web scraping is a process of extracting data from websites using automated tools. Web scrapers can be used to extract data from any website, regardless of whether the website has an API. However, web scraping can be more difficult and time-consuming than using an API.
In general, APIs are the preferred method for accessing data from websites. They are easier to use, more legal, and less likely to interfere with the website. However, web scraping can be used in cases where there is no API or where the API is not sufficient.
I mean, any bot you spin up is going to go away at the end of the month when they kill API access, right?
You can always scrape, or use your cookies. There are ways around this for one off bots. Not that I’m an advocate.
